New
Bigdata Engineer with Azure Experience
Charter Global, Inc.
This is a Full-time position in Plano, TX posted April 7, 2021.
Title Sr. Big Data Engineer with Azure Duration 12 Months+ Location Atlanta, GA (Preferred) or Plano, TX (Initial Remote) Required Experience Sr. Big Data Engineer with 5+ years of expert level experience Hands-on experience using Databricks -Delta Lake , PySparkScala-Spark on Azure cloud Experience loading data to Azure ADLS G2 and performing transformations using Azure Databricks Expert with using the larger Hadoop eco system using HiveHDFSSpark Experienced in creating and submitting Spark jobs Experienced with Kafka and real-time analytics Experienced working with Apache Nifi and Snowflake DB a plus Familiarity on Azure PAAS services like Azure event hub, Azure functions and Azure Redis Experience in high performance tuning and scalability Core Java and PythonSpark background and their related libraries and frameworks Experienced with Spring Framework and Spring Boot UnixLinux expertise comfortable with Linux operating system and Shell Scripting PLSQL, RDBMS background with OracleMySQL Design, Development, Unit and Integration testing of complex data pipelines and to handle data volumes to derive insights Ability to optimize code to be able to run efficiently with stipulated SLA
