• Streaming 

    • Strong experience of Kafka: Expertise in building event processing data data pipelines using Kafka, ZooKeepers, KSQL, KStream and Kafka Control Center
    • Expertise in Kafka Brokers
    • Expertise in Kafka Connectors such as MQ Connectors, ElasticSearch Connectors, JDBC Connectors, File Stream Connector, JMS Source Connector, Tasks, Workers, Converters, Transformers

  • Spark

    • Programming languages: pyspark, sparkcala, Java
    • Spark SQL
    • Spark Streaming
    • Elastic MapReduce
    • Spark DataFrames and Datasets
    • GraphX library

  • Data Engineering with

      • Python
      • Azure Data Factory, Data Lake, CosmosDB and Azure Data Bricks