-
Streaming
-
- Strong experience of Kafka: Expertise in building event processing data data pipelines using Kafka, ZooKeepers, KSQL, KStream and Kafka Control Center
- Expertise in Kafka Brokers
- Expertise in Kafka Connectors such as MQ Connectors, ElasticSearch Connectors, JDBC Connectors, File Stream Connector, JMS Source Connector, Tasks, Workers, Converters, Transformers
-
Spark
-
- Programming languages: pyspark, sparkcala, Java
- Spark SQL
- Spark Streaming
- Elastic MapReduce
- Spark DataFrames and Datasets
- GraphX library
-
Data Engineering with
-
-
- Python
-
-
-
- Azure Data Factory, Data Lake, CosmosDB and Azure Data Bricks
-