Arun Balaji

FAQ About Arun Balaji

• What is Arun Balaji's address?

  Arun Balaji is located at
  Chennai, Tamil Nadu, India

• What is Arun Balaji's job title?

  Arun Balaji is a
  Data Engineer at Walmart Global Tech GCP Dataproc, Spark, Scala, Hudi, Delta Lake Databricks certified: Data Engineer Associate Azure 1x. Have 3+ years of experience in big data technologies like Apache Spark ( PySpark ), Azure Databricks , Python , SQL , Spark SQL , Hive , Apache Airflow etc., Worked on both development and data migration projects in both onprem and cloud environments. Hands on experience working on complex data schemas like JSON for data ingestion from sources like API , AWS S3 etc., and data integration into data lakes / ETL and migration of batch pipelines to Databricks. Experience working with Spark optimization / tuning to achieve KPI improvement by reducing the job runtimes by greater than 60% in average and also reducing cluster costs by using optimal parameters and cluster sizes based on the workloads when handling huge data sources (greater than 50 TB in size). Also worked with ADLS as data lake with Databricks - Delta Lake , different file formats like Parquet, ORC etc., and scheduling / dependency management / orchestration with Apache Airflow - Astronomer. Have have experience working with big data and other tools like Hadoop , HDFS (Hadoop File System) , Hive , Presto , WinSCP , Shell scripting and Putty Walmart Global Tech

• What industry does Arun Balaji currently work in?

  Arun Balaji currently works in the
  Walmart Global Tech

• What is Arun Balaji's area of expertise?

  Arun Balaji specializes in
  Data Engineer at Walmart Global Tech GCP Dataproc, Spark, Scala, Hudi, Delta Lake Databricks certified: Data Engineer Associate Azure 1x. Have 3+ years of experience in big data technologies like Apache Spark ( PySpark ), Azure Databricks , Python , SQL , Spark SQL , Hive , Apache Airflow etc., Worked on both development and data migration projects in both onprem and cloud environments. Hands on experience working on complex data schemas like JSON for data ingestion from sources like API , AWS S3 etc., and data integration into data lakes / ETL and migration of batch pipelines to Databricks. Experience working with Spark optimization / tuning to achieve KPI improvement by reducing the job runtimes by greater than 60% in average and also reducing cluster costs by using optimal parameters and cluster sizes based on the workloads when handling huge data sources (greater than 50 TB in size). Also worked with ADLS as data lake with Databricks - Delta Lake , different file formats like Parquet, ORC etc., and scheduling / dependency management / orchestration with Apache Airflow - Astronomer. Have have experience working with big data and other tools like Hadoop , HDFS (Hadoop File System) , Hive , Presto , WinSCP , Shell scripting and Putty

• Which languages does Arun Balaji speak? 

  Arun Balaji speaks the following languages:
  No languages available.

• Which industries has Arun Balaji previously worked in?   

  Arun Balaji has prior experience in the following industries:
  Latentview Analytics

• What is Arun Balaji’s work experience?  

  Arun Balaji has the following professional experience:
  Walmart Global Tech , Latentview Analytics .

• How can I find Arun Balaji on LinkedIn?  

  You can view Arun Balaji’s
  LinkedIn profile at LinkedIn URL.

• What are Arun Balaji’s work email addresses?  

  Arun Balaji’s work email addresses are
  [email protected].

• What company does Arun Balaji work for?  

  Arun Balaji works at
  Walmart Global Tech