{"id":18163,"date":"2024-03-20T14:15:27","date_gmt":"2024-03-20T12:15:27","guid":{"rendered":"https:\/\/www.synthesis.co.za\/integrating-generative-ai-into-the-cloud-trends-for-2024-2\/"},"modified":"2024-03-22T12:22:05","modified_gmt":"2024-03-22T10:22:05","slug":"simplify-stream-processing-with-serverless-apache-flink-from-confluent-and-synthesis-software-technologies-pty-ltd","status":"publish","type":"post","link":"https:\/\/www.synthesis.co.za\/simplify-stream-processing-with-serverless-apache-flink-from-confluent-and-synthesis-software-technologies-pty-ltd\/","title":{"rendered":"Simplify Stream Processing With Serverless Apache Flink\u00ae From Confluent and Synthesis Software Technologies (Pty) Ltd"},"content":{"rendered":"\n<p>We\u2019re thrilled to be partnered with <a href=\"https:\/\/www.confluent.io\/\">Confluent<\/a> today as they announce the general availability of the industry\u2019s only <a href=\"https:\/\/www.confluent.io\/product\/flink\/\">cloud-native, serverless Apache Flink<sup>\u00ae<\/sup> service<\/a>. Available directly within Confluent\u2019s data streaming platform alongside a cloud-native service for Apache Kafka\u00ae, the new Flink offering is now ready for use on AWS, Azure, and Google Cloud. Directly integrated with Synthesis, Confluent provides a simple solution for accessing and processing data streams from across the entire business to build a real-time, contextual, and trustworthy knowledge base to fuel applications.<\/p>\n\n\n\n<p><strong><strong>Easily build high-quality, reusable data streams with the industry\u2019s only cloud-native, serverless Flink service<\/strong><\/strong><\/p>\n\n\n\n<p>Apache Flink is a unified stream <em>and<\/em> batch-processing framework that has been a top-five Apache project for many years. Flink has a strong, diverse contributor community backed by companies like Alibaba and Apple. It powers stream processing platforms at many companies, including digital natives like Uber, Netflix, and Linkedin, as well as successful enterprises like ING, Goldman Sachs, and Comcast.<\/p>\n\n\n\n<p>Fully integrated with Apache Kafka<sup>\u00ae<\/sup> on Confluent Cloud, Confluent\u2019s new Flink service allows businesses to:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Effortlessly filter, join and enrich your data streams with Flink<\/strong>, the de facto standard for stream processing<\/li>\n<\/ul>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Enable high-performance and efficient stream processing at any scale<\/strong>, without the complexities of infrastructure management<\/li>\n<\/ul>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Experience Kafka and Flink as a unified platform<\/strong>, with fully integrated monitoring, security, and governance<\/li>\n<\/ul>\n\n\n\n<p>Confluent\u2019s fully managed Flink service is now generally available across all three major cloud service providers, providing customers with a true multi-cloud solution and the flexibility to seamlessly deploy stream processing workloads everywhere their data and applications reside. Backed by a 99.99% uptime SLA, Confluent ensures reliable stream processing with support and services from the leading Kafka and Flink experts.<\/p>\n\n\n\n<p><strong>Getting Started<\/strong><\/p>\n\n\n\n<p>As Synthesis we have provided an easy way to illustrate how to get started as Data Engineer to develop and manage robust, scalable and resilient data streaming applications on Confluent\u2019s fully managed Flink platform, providing a wide range of data analytics solutions to different clients with multiple use cases across various industries.<\/p>\n\n\n\n<p>It is important for us to note that: Confluent Cloud for Apache Flink\u00ae\ufe0f is currently available for Preview. A Preview feature is a Confluent Cloud component that is being introduced to gain early feedback from developers. Preview features can be used for evaluation and non-production testing purposes or to provide feedback to Confluent.<\/p>\n\n\n\n<p>Below is an easy step-by-step getting started with descriptive \u201cHow-To\u2019s\u201d.<\/p>\n\n\n\n<p><strong>Step 1<\/strong>: Create a Flink compute pool<\/p>\n\n\n\n<p>Inside your desired confluent environment, select the <strong>Flink <\/strong>tab:<\/p>\n\n\n\n<p><img fetchpriority=\"high\" decoding=\"async\" width=\"506\" height=\"219\" src=\"https:\/\/lh7-us.googleusercontent.com\/5rLVgOAbGn_zsDpeLZIJyHIBFJClUaFNJ-61XbzKLXtFzlrw0DHwzIUbYkK0865oEzb-2K5HeZoYVmUj3-oVEhXOZlWroWWJ2lBwSY_Uki9bNWPWwqyRyIUjm6rUDEnnTLMD0iNUGaf1bvDsvguX3w\"><\/p>\n\n\n\n<p><strong>Step 2<\/strong>: Create a workspace<\/p>\n\n\n\n<p><img decoding=\"async\" width=\"488\" height=\"398\" src=\"https:\/\/lh7-us.googleusercontent.com\/Y6IWGQGn8AbSnVZQBGgg__Ugc90UEH4AM6ZexsXAqlZeyF_-KBOupvMurv6hH_8i-rdzi4QGYr_3rYtYCsd0wJ5VLmo0aRRq004645O7fzwytudTNKUVDtW0oInRH0t7g_qaTDCkanYuQsBgYejfTg\"><\/p>\n\n\n\n<p>Once you clink create new compute pool, you will have to set the pool name, and configure the maximum CFUs required, also note the compute charges per min that come with this configuration as it has an impact on your billing.<\/p>\n\n\n\n<p><strong>Step 3<\/strong>: Run a SQL statement<\/p>\n\n\n\n<p>Once you have your workspace created, click on the <strong>Open SQL workspace<\/strong> button to open the workspace with an SQL editor:<\/p>\n\n\n\n<p><img decoding=\"async\" width=\"345\" height=\"480\" src=\"https:\/\/lh7-us.googleusercontent.com\/ZZX2lADUxsmNtw7rlCsps3juvAdr71o2-RXBo2VWUdMZkirqWzPlK0_qzksJ8Qiu1sfOnga-BWkW62Lw_j8Sfor4c_xvRmJJtNP_3ydYGK4GeNEaB6CPdnBjDq0UOds9GvtQT7HzDA4dEiz9EVHPEg\"><\/p>\n\n\n\n<p>The editor should look similar to the image below with a <strong>Run<\/strong> and <strong>Stop<\/strong> button, these&nbsp; respectfully run and stop your FlinkSQL queries.<\/p>\n\n\n\n<p><img loading=\"lazy\" decoding=\"async\" width=\"480\" height=\"105\" src=\"https:\/\/lh7-us.googleusercontent.com\/Oot4szb6R7ciDtRcPSzrym4R75TPTRNlJ_ec5tPrsgHI4qP7KOGvJShjrRqu_ODDhklHiHIWCvFhSCs6lBf8pE2pbxfUP5e6iXMm7DNDeS9DTRvMmLM3I5F1d0M_krHd4_dCuSC3PVU5p7CXENl0Lw\"><\/p>\n\n\n\n<p><strong>Step 4a<\/strong>: (Optional) Query existing topics<\/p>\n\n\n\n<p>The <strong>CREATE TABLE <\/strong>can be used to<strong> <\/strong>create a table which will also create a corresponding topic.&nbsp;<\/p>\n\n\n\n<p>An example of how to create a table and configure a few properties:<\/p>\n\n\n\n<figure class=\"wp-block-table\"><table><tbody><tr><td>CREATE TABLE user_data (<br>&nbsp; `id` BIGINT,<br>&nbsp; `name` STRING,<br>&nbsp; `age` INT,<br>&nbsp; `created_at` TIMESTAMP_LTZ(3)<br>) WITH (<br>&nbsp; &#8216;kafka.cleanup-policy&#8217; = &#8216;delete&#8217;,<br>&nbsp; &#8216;kafka.retention.time&#8217; = &#8216;86400000&#8217;<br>);<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p>In this example, the <strong>WITH<\/strong> statement is used to configure the retention time and clean-up policy for the corresponding topic that was created.&nbsp;<\/p>\n\n\n\n<p><a href=\"https:\/\/docs.confluent.io\/cloud\/current\/flink\/reference\/statements\/create-table.html#with-options\">Click here<\/a> for documentation on more configurations that can be used with the WITH statement.<\/p>\n\n\n\n<p>Like SQL, the <strong>INSERT <\/strong>statement can be used to insert data into a table.<\/p>\n\n\n\n<p>An example of how to insert data into a table:<\/p>\n\n\n\n<figure class=\"wp-block-table\"><table><tbody><tr><td>INSERT INTO user_data VALUES (1234567890, &#8216;John Doe&#8217;, 24, CURRENT_TIMESTAMP);<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p>The <strong>SELECT<\/strong> statement allows for querying and filtering data inside a table or topic.<\/p>\n\n\n\n<p>An example of how to query all the data inside a table or topic:<\/p>\n\n\n\n<figure class=\"wp-block-table\"><table><tbody><tr><td>SELECT *FROM user_data<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p>Output:<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/lh7-us.googleusercontent.com\/fo5xuuVZeb1Jzpy1x6nxBDQD0BnK-i1JJxau7B-uU8XPLSny5Re4ozEDXFMoT8wQH0nvDV8s6U0cwCpJ4Ws8tXQ-oe69S0Xx_OUmaQwsto-g2mVbv5XUEXWCxGdhRmPyDoYVJVecmLOt30NqwFHe7w\" alt=\"\"\/><\/figure>\n\n\n\n<p>We can filter our results by using the <strong>WHERE<\/strong> statement.&nbsp;<\/p>\n\n\n\n<p>An example of filtering users that are 35 years old:<\/p>\n\n\n\n<figure class=\"wp-block-table\"><table><tbody><tr><td>SELECT *<br>FROM user_data u<br>WHERE u.age = 35<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p>Output:<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/lh7-us.googleusercontent.com\/zn2-b90DbBFnm-927XMp6862imay1VqN1ge2Ho0htIloq2GPIxJHq1yBXKRNkgNF2Zss6UEbDxfiav0tYzhchSjEDxHyD26eWfKVXwUqSxMgwA0Vx56Nrhf9RrmjQwjgs85Xf8Apzofl4kXLfx8o7w\" alt=\"\"\/><\/figure>\n\n\n\n<p><strong>Step 4b<\/strong>: (Optional) Using Sample Data<\/p>\n\n\n\n<p>Here is an example of using mock telematics data for filtering, joining and windowing for the desired useful data.&nbsp;&nbsp;<\/p>\n\n\n\n<p>There is a constant stream of vehicle events flowing into the topic <strong>vehicle_data <\/strong>and a<strong> <\/strong>stream of periodic location events flowing into the <strong>compacted <\/strong>topic <strong>location_data<\/strong>:<\/p>\n\n\n\n<p>Both of these topics can be used to create several enriched streams of data for business use.&nbsp;<\/p>\n\n\n\n<p>Example of vehicle_data event:&nbsp;<\/p>\n\n\n\n<figure class=\"wp-block-table\"><table><tbody><tr><td>{<br>&nbsp; &#8220;id&#8221;: &#8220;081d2d60-8fe4-4319-b090-93ab2c56f8d6&#8221;,<br>&nbsp; &#8220;car&#8221;: &#8220;Toyota Starlet&#8221;,<br>&nbsp; &#8220;state&#8221;: &#8220;driving&#8221;,<br>&nbsp; &#8220;speed&#8221;: 117.30,<br>&nbsp; &#8220;speed_unit&#8221;: &#8220;km\/h&#8221;,<br>&nbsp; &#8220;road_name&#8221;: &#8220;B22 Highway&#8221;,<br>&nbsp; &#8220;position_x&#8221;: -283.04,<br>&nbsp; &#8220;position_y&#8221;: -144.08,<br>&nbsp; &#8220;created_by&#8221;: 1709645218966<br>}<br><br><\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p>Example of location_data event:&nbsp;<\/p>\n\n\n\n<figure class=\"wp-block-table\"><table><tbody><tr><td>{<br>&nbsp; &#8220;name&#8221;: &#8220;B22 Highway&#8221;,<br>&nbsp; &#8220;traffic&#8221;: &#8220;Very High&#8221;,<br>&nbsp; &#8220;temperature&#8221;: 26.0,<br>&nbsp; &#8220;temperature_unit&#8221;: &#8220;Degree Celsius&#8221;,<br>&nbsp; &#8220;weather&#8221;: &#8220;Sunny&#8221;<br>}<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p>For the vehicle_data, it will only be beneficial to the business once there is some analysis done by streaming the vehicle events and joining them to the location events which will enrich the data for meaningful analysis.<\/p>\n\n\n\n<p>This is where the Flink application comes into play and jobs can scale up based on the underlying configuration done at the compute pool level. This then allows seamless scaling up and down to provide optimal performance without the intervention of a support engineer.&nbsp;<\/p>\n\n\n\n<p>Vehicle and Location data can be joined on their common column:<\/p>\n\n\n\n<figure class=\"wp-block-table\"><table><tbody><tr><td>SELECT *<br>FROM vehicle_data v<br>INNER JOIN location_data l<br>ON v.road_name = l.name<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p>We can apply filters to get only the useful information out of this stream, for instance, vehicles that are driving on high-traffic roads.<\/p>\n\n\n\n<p>Here is an example of a filtered join:<\/p>\n\n\n\n<figure class=\"wp-block-table\"><table><tbody><tr><td>SELECT *<br>FROM vehicle_data v<br>INNER JOIN location_data l<br>ON v.road_name = l.name<br>WHERE v.state = &#8216;driving&#8217; AND l.traffic = &#8216;Very High&#8217;<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p>We can create a hopping window to identify each vehicle&#8217;s average speed. A hopping time window has a fixed duration and hops by a specified hop interval. In this case, we want the hopping window to overlap therefore we will set the hopping interval to smaller than the windowing duration.<\/p>\n\n\n\n<p>Here is an example of a hopping window query:&nbsp;&nbsp;<\/p>\n\n\n\n<figure class=\"wp-block-table\"><table><tbody><tr><td>SELECT window_start, window_end, AVG(speed) AS average_speed<br>&nbsp; FROM TABLE(<br>&nbsp; &nbsp; HOP(TABLE vehicle_data,&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;DESCRIPTOR(created_by),&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;INTERVAL &#8216;1&#8217; MINUTE,&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;INTERVAL &#8216;2&#8217; MINUTE&nbsp;&nbsp;&nbsp;&nbsp;)&nbsp;&nbsp;)<br>&nbsp; GROUP BY id, window_start, window_end;<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p>The power of confluent cloud-managed Flink has a number of benefits that a Data Streaming engineer or team can leverage, and they are illustrated below.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>We\u2019re thrilled to be partnered with Confluent today as they announce the general availability of the industry\u2019s only cloud-native, serverless Apache Flink\u00ae service. Available directly within Confluent\u2019s data streaming platform alongside a cloud-native service for Apache Kafka\u00ae, the new Flink offering is now ready for use on AWS, Azure, and Google Cloud. Directly integrated with [&hellip;]<\/p>\n","protected":false},"author":12,"featured_media":18172,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"inline_featured_image":false,"episode_type":"","audio_file":"","cover_image":"","cover_image_id":"","duration":"","filesize":"","filesize_raw":"","date_recorded":"","explicit":"","block":"","itunes_episode_number":"","itunes_title":"","itunes_season_number":"","itunes_episode_type":"","footnotes":""},"categories":[1],"tags":[],"ptype":[11],"sectors":[26],"class_list":["post-18163","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorized","ptype-articles","sectors-cloud"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v27.0 (Yoast SEO v27.0) - https:\/\/yoast.com\/product\/yoast-seo-premium-wordpress\/ -->\n<title>Simplify Stream Processing With Serverless Apache Flink\u00ae From Confluent and Synthesis Software Technologies (Pty) Ltd - Synthesis<\/title>\n<meta name=\"description\" content=\"Read: &#039;Simplify Stream Processing With Serverless Apache Flink\u00ae From Confluent and Synthesis Software Technologies (Pty) Ltd&#039; and more on the Synthesis blog for insights on the latest in the Tech and Software development industry.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.synthesis.co.za\/simplify-stream-processing-with-serverless-apache-flink-from-confluent-and-synthesis-software-technologies-pty-ltd\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Simplify Stream Processing With Serverless Apache Flink\u00ae From Confluent and Synthesis Software Technologies (Pty) Ltd\" \/>\n<meta property=\"og:description\" content=\"Read: &#039;Simplify Stream Processing With Serverless Apache Flink\u00ae From Confluent and Synthesis Software Technologies (Pty) Ltd&#039; and more on the Synthesis blog for insights on the latest in the Tech and Software development industry.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.synthesis.co.za\/simplify-stream-processing-with-serverless-apache-flink-from-confluent-and-synthesis-software-technologies-pty-ltd\/\" \/>\n<meta property=\"og:site_name\" content=\"Synthesis\" \/>\n<meta property=\"article:published_time\" content=\"2024-03-20T12:15:27+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-03-22T10:22:05+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.synthesis.co.za\/wp-content\/uploads\/2024\/03\/MicrosoftTeams-image-2.png\" \/>\n\t<meta property=\"og:image:width\" content=\"960\" \/>\n\t<meta property=\"og:image:height\" content=\"540\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Synthesis Staff\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Synthesis Staff\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"6 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.synthesis.co.za\/simplify-stream-processing-with-serverless-apache-flink-from-confluent-and-synthesis-software-technologies-pty-ltd\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.synthesis.co.za\/simplify-stream-processing-with-serverless-apache-flink-from-confluent-and-synthesis-software-technologies-pty-ltd\/\"},\"author\":{\"name\":\"Synthesis Staff\",\"@id\":\"https:\/\/www.synthesis.co.za\/#\/schema\/person\/a1cde004c078942c45be61a61cd6ae2c\"},\"headline\":\"Simplify Stream Processing With Serverless Apache Flink\u00ae From Confluent and Synthesis Software Technologies (Pty) Ltd\",\"datePublished\":\"2024-03-20T12:15:27+00:00\",\"dateModified\":\"2024-03-22T10:22:05+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.synthesis.co.za\/simplify-stream-processing-with-serverless-apache-flink-from-confluent-and-synthesis-software-technologies-pty-ltd\/\"},\"wordCount\":1189,\"publisher\":{\"@id\":\"https:\/\/www.synthesis.co.za\/#organization\"},\"image\":{\"@id\":\"https:\/\/www.synthesis.co.za\/simplify-stream-processing-with-serverless-apache-flink-from-confluent-and-synthesis-software-technologies-pty-ltd\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.synthesis.co.za\/wp-content\/uploads\/2024\/03\/MicrosoftTeams-image-2.png\",\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.synthesis.co.za\/simplify-stream-processing-with-serverless-apache-flink-from-confluent-and-synthesis-software-technologies-pty-ltd\/\",\"url\":\"https:\/\/www.synthesis.co.za\/simplify-stream-processing-with-serverless-apache-flink-from-confluent-and-synthesis-software-technologies-pty-ltd\/\",\"name\":\"Simplify Stream Processing With Serverless Apache Flink\u00ae From Confluent and Synthesis Software Technologies (Pty) Ltd - Synthesis\",\"isPartOf\":{\"@id\":\"https:\/\/www.synthesis.co.za\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.synthesis.co.za\/simplify-stream-processing-with-serverless-apache-flink-from-confluent-and-synthesis-software-technologies-pty-ltd\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.synthesis.co.za\/simplify-stream-processing-with-serverless-apache-flink-from-confluent-and-synthesis-software-technologies-pty-ltd\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.synthesis.co.za\/wp-content\/uploads\/2024\/03\/MicrosoftTeams-image-2.png\",\"datePublished\":\"2024-03-20T12:15:27+00:00\",\"dateModified\":\"2024-03-22T10:22:05+00:00\",\"description\":\"Read: 'Simplify Stream Processing With Serverless Apache Flink\u00ae From Confluent and Synthesis Software Technologies (Pty) Ltd' and more on the Synthesis blog for insights on the latest in the Tech and Software development industry.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.synthesis.co.za\/simplify-stream-processing-with-serverless-apache-flink-from-confluent-and-synthesis-software-technologies-pty-ltd\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.synthesis.co.za\/simplify-stream-processing-with-serverless-apache-flink-from-confluent-and-synthesis-software-technologies-pty-ltd\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.synthesis.co.za\/simplify-stream-processing-with-serverless-apache-flink-from-confluent-and-synthesis-software-technologies-pty-ltd\/#primaryimage\",\"url\":\"https:\/\/www.synthesis.co.za\/wp-content\/uploads\/2024\/03\/MicrosoftTeams-image-2.png\",\"contentUrl\":\"https:\/\/www.synthesis.co.za\/wp-content\/uploads\/2024\/03\/MicrosoftTeams-image-2.png\",\"width\":960,\"height\":540},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.synthesis.co.za\/simplify-stream-processing-with-serverless-apache-flink-from-confluent-and-synthesis-software-technologies-pty-ltd\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.synthesis.co.za\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Simplify Stream Processing With Serverless Apache Flink\u00ae From Confluent and Synthesis Software Technologies (Pty) Ltd\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.synthesis.co.za\/#website\",\"url\":\"https:\/\/www.synthesis.co.za\/\",\"name\":\"Synthesis\",\"description\":\"Specialized Software Development\",\"publisher\":{\"@id\":\"https:\/\/www.synthesis.co.za\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.synthesis.co.za\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.synthesis.co.za\/#organization\",\"name\":\"Synthesis, a Leading Software Development Company\",\"url\":\"https:\/\/www.synthesis.co.za\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.synthesis.co.za\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.synthesis.co.za\/wp-content\/uploads\/2016\/03\/Synthesis-logo.jpg\",\"contentUrl\":\"https:\/\/www.synthesis.co.za\/wp-content\/uploads\/2016\/03\/Synthesis-logo.jpg\",\"width\":1036,\"height\":220,\"caption\":\"Synthesis, a Leading Software Development Company\"},\"image\":{\"@id\":\"https:\/\/www.synthesis.co.za\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.synthesis.co.za\/#\/schema\/person\/a1cde004c078942c45be61a61cd6ae2c\",\"name\":\"Synthesis Staff\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.synthesis.co.za\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/www.synthesis.co.za\/wp-content\/uploads\/2020\/03\/cropped-favicon-1-96x96.png\",\"contentUrl\":\"https:\/\/www.synthesis.co.za\/wp-content\/uploads\/2020\/03\/cropped-favicon-1-96x96.png\",\"caption\":\"Synthesis Staff\"},\"url\":\"https:\/\/www.synthesis.co.za\/author\/staff\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Simplify Stream Processing With Serverless Apache Flink\u00ae From Confluent and Synthesis Software Technologies (Pty) Ltd - Synthesis","description":"Read: 'Simplify Stream Processing With Serverless Apache Flink\u00ae From Confluent and Synthesis Software Technologies (Pty) Ltd' and more on the Synthesis blog for insights on the latest in the Tech and Software development industry.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.synthesis.co.za\/simplify-stream-processing-with-serverless-apache-flink-from-confluent-and-synthesis-software-technologies-pty-ltd\/","og_locale":"en_US","og_type":"article","og_title":"Simplify Stream Processing With Serverless Apache Flink\u00ae From Confluent and Synthesis Software Technologies (Pty) Ltd","og_description":"Read: 'Simplify Stream Processing With Serverless Apache Flink\u00ae From Confluent and Synthesis Software Technologies (Pty) Ltd' and more on the Synthesis blog for insights on the latest in the Tech and Software development industry.","og_url":"https:\/\/www.synthesis.co.za\/simplify-stream-processing-with-serverless-apache-flink-from-confluent-and-synthesis-software-technologies-pty-ltd\/","og_site_name":"Synthesis","article_published_time":"2024-03-20T12:15:27+00:00","article_modified_time":"2024-03-22T10:22:05+00:00","og_image":[{"width":960,"height":540,"url":"https:\/\/www.synthesis.co.za\/wp-content\/uploads\/2024\/03\/MicrosoftTeams-image-2.png","type":"image\/png"}],"author":"Synthesis Staff","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Synthesis Staff","Est. reading time":"6 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.synthesis.co.za\/simplify-stream-processing-with-serverless-apache-flink-from-confluent-and-synthesis-software-technologies-pty-ltd\/#article","isPartOf":{"@id":"https:\/\/www.synthesis.co.za\/simplify-stream-processing-with-serverless-apache-flink-from-confluent-and-synthesis-software-technologies-pty-ltd\/"},"author":{"name":"Synthesis Staff","@id":"https:\/\/www.synthesis.co.za\/#\/schema\/person\/a1cde004c078942c45be61a61cd6ae2c"},"headline":"Simplify Stream Processing With Serverless Apache Flink\u00ae From Confluent and Synthesis Software Technologies (Pty) Ltd","datePublished":"2024-03-20T12:15:27+00:00","dateModified":"2024-03-22T10:22:05+00:00","mainEntityOfPage":{"@id":"https:\/\/www.synthesis.co.za\/simplify-stream-processing-with-serverless-apache-flink-from-confluent-and-synthesis-software-technologies-pty-ltd\/"},"wordCount":1189,"publisher":{"@id":"https:\/\/www.synthesis.co.za\/#organization"},"image":{"@id":"https:\/\/www.synthesis.co.za\/simplify-stream-processing-with-serverless-apache-flink-from-confluent-and-synthesis-software-technologies-pty-ltd\/#primaryimage"},"thumbnailUrl":"https:\/\/www.synthesis.co.za\/wp-content\/uploads\/2024\/03\/MicrosoftTeams-image-2.png","inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.synthesis.co.za\/simplify-stream-processing-with-serverless-apache-flink-from-confluent-and-synthesis-software-technologies-pty-ltd\/","url":"https:\/\/www.synthesis.co.za\/simplify-stream-processing-with-serverless-apache-flink-from-confluent-and-synthesis-software-technologies-pty-ltd\/","name":"Simplify Stream Processing With Serverless Apache Flink\u00ae From Confluent and Synthesis Software Technologies (Pty) Ltd - Synthesis","isPartOf":{"@id":"https:\/\/www.synthesis.co.za\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.synthesis.co.za\/simplify-stream-processing-with-serverless-apache-flink-from-confluent-and-synthesis-software-technologies-pty-ltd\/#primaryimage"},"image":{"@id":"https:\/\/www.synthesis.co.za\/simplify-stream-processing-with-serverless-apache-flink-from-confluent-and-synthesis-software-technologies-pty-ltd\/#primaryimage"},"thumbnailUrl":"https:\/\/www.synthesis.co.za\/wp-content\/uploads\/2024\/03\/MicrosoftTeams-image-2.png","datePublished":"2024-03-20T12:15:27+00:00","dateModified":"2024-03-22T10:22:05+00:00","description":"Read: 'Simplify Stream Processing With Serverless Apache Flink\u00ae From Confluent and Synthesis Software Technologies (Pty) Ltd' and more on the Synthesis blog for insights on the latest in the Tech and Software development industry.","breadcrumb":{"@id":"https:\/\/www.synthesis.co.za\/simplify-stream-processing-with-serverless-apache-flink-from-confluent-and-synthesis-software-technologies-pty-ltd\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.synthesis.co.za\/simplify-stream-processing-with-serverless-apache-flink-from-confluent-and-synthesis-software-technologies-pty-ltd\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.synthesis.co.za\/simplify-stream-processing-with-serverless-apache-flink-from-confluent-and-synthesis-software-technologies-pty-ltd\/#primaryimage","url":"https:\/\/www.synthesis.co.za\/wp-content\/uploads\/2024\/03\/MicrosoftTeams-image-2.png","contentUrl":"https:\/\/www.synthesis.co.za\/wp-content\/uploads\/2024\/03\/MicrosoftTeams-image-2.png","width":960,"height":540},{"@type":"BreadcrumbList","@id":"https:\/\/www.synthesis.co.za\/simplify-stream-processing-with-serverless-apache-flink-from-confluent-and-synthesis-software-technologies-pty-ltd\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.synthesis.co.za\/"},{"@type":"ListItem","position":2,"name":"Simplify Stream Processing With Serverless Apache Flink\u00ae From Confluent and Synthesis Software Technologies (Pty) Ltd"}]},{"@type":"WebSite","@id":"https:\/\/www.synthesis.co.za\/#website","url":"https:\/\/www.synthesis.co.za\/","name":"Synthesis","description":"Specialized Software Development","publisher":{"@id":"https:\/\/www.synthesis.co.za\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.synthesis.co.za\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.synthesis.co.za\/#organization","name":"Synthesis, a Leading Software Development Company","url":"https:\/\/www.synthesis.co.za\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.synthesis.co.za\/#\/schema\/logo\/image\/","url":"https:\/\/www.synthesis.co.za\/wp-content\/uploads\/2016\/03\/Synthesis-logo.jpg","contentUrl":"https:\/\/www.synthesis.co.za\/wp-content\/uploads\/2016\/03\/Synthesis-logo.jpg","width":1036,"height":220,"caption":"Synthesis, a Leading Software Development Company"},"image":{"@id":"https:\/\/www.synthesis.co.za\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/www.synthesis.co.za\/#\/schema\/person\/a1cde004c078942c45be61a61cd6ae2c","name":"Synthesis Staff","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.synthesis.co.za\/#\/schema\/person\/image\/","url":"https:\/\/www.synthesis.co.za\/wp-content\/uploads\/2020\/03\/cropped-favicon-1-96x96.png","contentUrl":"https:\/\/www.synthesis.co.za\/wp-content\/uploads\/2020\/03\/cropped-favicon-1-96x96.png","caption":"Synthesis Staff"},"url":"https:\/\/www.synthesis.co.za\/author\/staff\/"}]}},"_links":{"self":[{"href":"https:\/\/www.synthesis.co.za\/wp-json\/wp\/v2\/posts\/18163","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.synthesis.co.za\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.synthesis.co.za\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.synthesis.co.za\/wp-json\/wp\/v2\/users\/12"}],"replies":[{"embeddable":true,"href":"https:\/\/www.synthesis.co.za\/wp-json\/wp\/v2\/comments?post=18163"}],"version-history":[{"count":3,"href":"https:\/\/www.synthesis.co.za\/wp-json\/wp\/v2\/posts\/18163\/revisions"}],"predecessor-version":[{"id":18167,"href":"https:\/\/www.synthesis.co.za\/wp-json\/wp\/v2\/posts\/18163\/revisions\/18167"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.synthesis.co.za\/wp-json\/wp\/v2\/media\/18172"}],"wp:attachment":[{"href":"https:\/\/www.synthesis.co.za\/wp-json\/wp\/v2\/media?parent=18163"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.synthesis.co.za\/wp-json\/wp\/v2\/categories?post=18163"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.synthesis.co.za\/wp-json\/wp\/v2\/tags?post=18163"},{"taxonomy":"ptype","embeddable":true,"href":"https:\/\/www.synthesis.co.za\/wp-json\/wp\/v2\/ptype?post=18163"},{"taxonomy":"sectors","embeddable":true,"href":"https:\/\/www.synthesis.co.za\/wp-json\/wp\/v2\/sectors?post=18163"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}