Today’s streaming architectures are far more demanding in terms of scale, volume and the urgency for real-time insights. The advent of IoT and other edge related use cases have sprouted a need for a strong backbone in the enterprise architecture that can handle the differing data inflows, outflows and consumption patterns of various applications across the streaming landscape. Over the last few years, Apache Kafka has emerged as that backbone. Kafka has evolved significantly from being just a messaging platform into a complex ecosystem of components that work tightly to deliver stream processing and analytics.
Cloudera and Hortonworks have been supporting Kafka over the years and now with the combined offering under Cloudera DataFlow, we have the largest number of Kafka customers supported across the world. We have also been innovating across the Kafka ecosystem of components. The key differentiator with the way we enable our customers with Kafka is offering it as a part of the Cloudera DataFlow (CDF) platform. It is tightly integrated with the rest of the components in the platform as well as with the enterprise services for unified security and governance.
Cloudera Stream Processing (CSP) is a product within the Cloudera DataFlow platform that packs Kafka along with some key streaming components that empower enterprises to handle some of the most complex and sophisticated streaming use cases. CSP provides advanced messaging, real-time processing and analytics on real-time streaming data using Apache Kafka. CSP also supports key management and monitoring capabilities powered by Cloudera Streams Management (CSM).
Cloudera Stream Processing consists of the following:
• Support for latest version of Kafka
• Support for Kafka Streams
• Schema Registry that provides a centralized registry to manage schema for Apache Kafka and Apache NiFi
• Support for Kafka replication with Mirrormaker
• Cluster Management and monitoring with Cloudera Manager
• Rich access control with Apache Sentry
What’s coming next
We will be shortly announcing Cloudera Streams Management that includes some of the innovative management and monitoring components for enterprise Kafka –
• Streams Messaging Manager (SMM) – A single management & monitoring tool that cures “Kafka Blindness” by providing complete transparency across all aspects of Kafka – Producers, Consumers, Topics and Brokers. It enables developers/DevOps teams, Platform Operations teams and Security/Governance teams with edge-to-enterprise visibility of all that is happening within your Kafka clusters. This is a tool that has already been widely adopted by the legacy Hortonworks customer base that have Kafka. Now, soon, all legacy Cloudera customers that have Kafka can also take advantage of this tool.
• Streams Replication Manager (SRM) – This is our upcoming product on Kafka replication based on the completely re-energized Mirrormaker 2.0. Watch this space for more details on this in the coming weeks.
Dinesh Chandrasekhar is Head of Product Marketing at Cloudera.
21 en 22 maart 2023 Organisaties hebben behoefte aan data science, selfservice BI, embedded BI, edge analytics en klantgedreven BI. Vaak is het dan ook tijd voor een nieuwe, toekomstbestendige data-architectuur. Dit tweedaagse seminar geeft antwoord ...
4 april 2023 (Face-to-face én Live Video Stream) Schrijf in voor al weer de tiende editie van ons jaarlijkse congres met wederom een ijzersterke sprekers line-up. Op deze editie behandelen wij belangrijke thema’s als Datamesh, Analytics ...
5 april 2023 Praktisch en interactief seminar met Nigel Turner Data-gedreven worden lukt niet door alleen nieuwe technologie en tools aan te schaffen. Het vereist een transformatie van bestaande business modellen, met cultuurverandering, een herontwe...
5 april 2023 (halve dag)Praktische workshop met Alec Sharp This workshop introduces concept modelling from a non-technical perspective, provides tips and guidelines for the analyst, and explores entity-relationship modelling at conceptual and logical...
5 april 2023 (halve dag)Praktische workshop door Thomas Frisendal In deze workshop van een halve dag zal de Deense expert Thomas Frisendal laten zien wat graph technologieën in de praktijk betekenen. Hij zal ook laten zien hoe graph oplossi...
13 april 2023 Praktische workshop Datavisualisatie en Human Data Stories. Hoe gaat u van data naar inzicht? En hoe gaat u om met grote hoeveelheden data, de noodzaak van storytelling, data science en de data artist? Lex Pierik behandelt de stromingen...
8 t/m 10 mei 2023 Praktische workshop Data Management Fundamentals door Chris Bradley - CDMP-examinatie optioneel De DAMA DMBoK2 beschrijft 11 disciplines van Data Management, waarbij Data Governance centraal staat. De Certified Data Managemen...
11 en 12 mei 2023 Praktische workshop Data Governance & Stewardship door Chris Bradley - CDMP-examinatie optioneel Wat betekent Data Governance eigenlijk, hoe kunnen we het praktisch laten werken en wat zijn de implicaties? Deze 2-daagse cursus bie...
Deel dit bericht