Pulsar Summit yes Apache Pulsar The annual community event , It will be distributed all over the world Apache Pulsar project Contributor、Committer And businesses CTO/CIO、 developer 、 Architects 、 Data scientist , And the elite of the messaging and streaming computing community gathered . At this grand gathering , Let's share our practical experience 、 Exchange ideas 、 Discuss about Pulsar Project and community knowledge , Learn from each other .

Dear community partners ,Pulsar Summit The San Francisco summit will be held in North America time 8 month 18 Held offline on the th ！ Welcome to the community （ Ensure personal travel complies with local regulations ）～

Summit information

Summit time ： North American Pacific time 8 month 18 Japan  

The venue of the summit ： San Francisco · Hotel Nikko

Highlight topics

The depth resolution Apache Pulsar Message retransmission

• •  The guest ：David Kjerrumgaard,Apache Pulsar Committer,StreamNative Preacher

• •  Details of the issue ：Pulsar Retransmission semantics are critical for scenarios that prevent duplication or out of sequence processing when message acknowledgments are not received . This lecture will introduce retransmission semantics , And share the best practices of configuring message retransmission in various scenarios .

KoP (Kafka-On-Pulsar) ： from Kafka Smooth migration to Pulsar

• •  The guest ：Ricardo Ferreira,AWS Senior preacher

• •  Details of the issue ： This lecture will introduce how to unlock infinite event stream reservation , And in an architecture that does not require rebalancing 、 Use with native support for event processing Apache Pulsar by Apache Kafka The micro service written provides multi tenancy ; The architecture of plug-in protocol and KoP（Kafka-on-Pulsar） How it works .

Batch flow integration ： Use Apache Flink + Apache Pulsar Build a stream data pipeline

• •  The guest ：Caito Scherr,Ververica Preacher

• •  Details of the issue ： This lecture will demonstrate how to use Apache Pulsar and Flink SQL Build a batch flow integrated processing pipeline .

Build a new generation Lakehouse：Apache Pulsar and Delta Lake Ecological integration

• •  The guest ：Denny Lee,Delta Lake Committer,Databricks Senior preacher

• •  Details of the issue ： This share will introduce support Lakehouse Architecturally Delta Lake The main function of , as well as Delta Lake And Pulsar Integrated future surrounding ecosystem .

Apache Pulsar go to the battle-front without any burden ： Towards light ZooKeeper Time

• •  The guest ：Matteo Merli,Apache Pulsar PMC chairman ,StreamNative CTO

• •  Details of the issue ：Apache Pulsar 2.10 To reduce the Pulsar Yes Apache ZooKeeper Dependence , A pluggable framework is introduced to support users to choose replaceable metadata and coordination system according to the actual deployment environment . This share will introduce how to use in Kubernetes Medium etcd Services act as Pulsar Metadata storage for , Realization Pulsar nothing ZooKeeper.

Other issues （ Ongoing update ）

Apache Pulsar Application in the event driven microservice scenario ：Blue-Green Integrate Pulsar and Envoy Experience sharing

• •  The guest ：

• Kai Levy,Toast Senior engineer

• Zach Walsh,Toast Senior engineer

The depth resolution Broker Rebalance Mechanism

• •  The guest ：Heesung Sohn,StreamNative Development Engineer

• •  Details of the issue ：Pulsar It is a horizontally scalable message system . So to ensure full utilization broker layer , The traffic in the logical cluster must be in all available Pulsar broker Try to achieve balance between . In this speech , We will introduce Apache Pulsar Load balancing of , And focus on some that can be used to control cross Pulsar broker Mechanism of load distribution . Last , We will discuss the various load shedding strategies available , And how to correctly configure Pulsar To meet the load demand .

Analyze Apache Pulsar verification

• •  The guest ：Lari Hotari,DataStax The engineer

• •  Details of the issue ： In case of failure ,Pulsar How long will it take to recover ？ Whether the fault will cause Pulsar Unavailable ？ How the fault affects Pulsar Throughput and latency ？ Even if the component fails , Is it possible to ensure that no messages are lost ？...... This speech will find the answers to these questions , And share how to apply tools and practices to testing and verification .

simplify Pulsar Functions—— Unlock SQL service

• •  The guest ： Lu Neng ,StreamNative Platform Engineer in charge

• •  Details of the issue ：Pulsar Functions yes Apache Pulsar Provides a framework for real-time data processing , Can be used for ETL The Conduit 、 Event driven applications and simple data analysis . although Pulsar Functions An extremely simple programming interface has been provided , But we hope to further reduce the threshold for users to access real-time data , And decided to Pulsar Functions Add a SQL Express layer . In this speech , We will introduce SQL grammar 、Pulsar Functions and Function Mesh How to work together , Provide a unique user development experience for real-time data jobs in the cloud environment .

Unlock Lakehouse：Apache Pulsar + Apache Hudi

• •  The guest ：

• Addison Higham,Apache Pulsar Committer,StreamNative Engineer in charge

• Alexey Kudinkin,Onehouse The founding Engineer

• •  Details of the issue ：Lakehouse It is a very popular data platform architecture method . In this speech , We will discuss how to use Apache Hudi Build completely open source Lakehouse, And it's time to Lakehouse And Apache Pulsar Integration of .

About Apache Pulsar

Message queue and stream fusion system in cloud native era , Provide a unified consumption model , It supports two scenarios: message queue and flow , It can provide enterprise level read-write service quality and strong consistency guarantee for queue scenarios , It can also provide high throughput for streaming scenes 、 Low latency ; Using storage computing separation architecture , Support large clusters 、 multi-tenancy 、 Million level Topic、 Cross regional data replication 、 Persistent storage 、 Hierarchical storage 、 High scalability and other enterprise level and financial level functions .

GitHub Address ：http://github.com/apache/pulsar/

About the Organizer StreamNative

StreamNative It's an open source basic software company , from Apache Software foundation top projects Apache Pulsar The founding team , around Pulsar Build the next generation of cloud native batch stream fusion data platform .StreamNative As Apache Pulsar Commercial company , Focus on open source ecology and community building , Committed to innovation in the field of cutting edge technology , Members of the founding team have worked in Yahoo、Twitter、Splunk、EMC And so on .

7 month 16 Japan Pulsar Meetup live broadcast , Welcome to scan the code and make an appointment

Click to read the original text , Sign up for the summit ～