Azure, Notebooks, Spark-Scala, Bigdata.
3
• Tot – 6+ yrs
• Relevant required 4+ years of experience as lead developer with Datawarehouse, Big data and Hadoop implementation in Azure environment
• Participate in design and implementation of the analytics architecture.
• Experience in working on Hadoop Distribution, good understanding of core concepts and best practices
• Good experience in building/tuning Spark pipelines in Python/Java/Scala
• Good experience in writing complex Hive queries to drive business critical insights
• Understanding of Data Lake vs Data Warehousing concepts
• Experience with AWS Cloud, exposure to Lambda/EMR/Kinesis will be good to have.
Work with multiple teams, arrive at common decision understand architecture principle of organization and provide solution accordingly
Responsibilities
Azure, Notebooks, Spark-Scala, Bigdata.
3
• Tot – 6+ yrs
• Relevant required 4+ years of experience as lead developer with Datawarehouse, Big data and Hadoop implementation in Azure environment
• Participate in design and implementation of the analytics architecture.
• Experience in working on Hadoop Distribution, good understanding of core concepts and best practices
• Good experience in building/tuning Spark pipelines in Python/Java/Scala
• Good experience in writing complex Hive queries to drive business critical insights
• Understanding of Data Lake vs Data Warehousing concepts
• Experience with AWS Cloud, exposure to Lambda/EMR/Kinesis will be good to have.
Work with multiple teams, arrive at common decision understand architecture principle of organization and provide solution accordingly
Salary : As per industry standard.
Industry :IT-Software / Software Services
Functional Area : IT Software - Application Programming , Maintenance
Profile Required
Proficiency in Big Data technologies such as Hadoop, Spark, Hive, HBase, Kafka, and related ecosystem tools.
Experience with cluster management and resource allocation frameworks like YARN or Mesos.
Expertise in Linux/Unix operating systems and shell scripting (e.g., Bash).
Strong understanding of distributed computing principles and performance optimization techniques.
Experience with configuration management and automation tools like Ansible or Puppet.
Familiarity with version control systems like Git and collaborative development platforms like GitHub.
Knowledge of SQL and scripting languages like Python for data manipulation and analysis.
Understanding of monitoring and logging tools such as ELK stack (Elasticsearch, Logstash, Kibana) or Splunk.
Experience with job scheduling and orchestration tools like Control-M, Oozie, or Airflow.
Should be willing to work on rotational shift
Should be willing to take on call supports
Specific Context
We are seeking a highly skilled and experienced Big Data Production Support Engineer to join our team. As the Production Support Engineer, you will be responsible for ensuring the stability, availability, and performance of our Big Data infrastructure and applications. Coordinate with cross-functional teams, and employ your technical expertise to anticipate and resolve production incidents.
Responsibilities
Profile Required
Proficiency in Big Data technologies such as Hadoop, Spark, Hive, HBase, Kafka, and related ecosystem tools.
Experience with cluster management and resource allocation frameworks like YARN or Mesos.
Expertise in Linux/Unix operating systems and shell scripting (e.g., Bash).
Strong understanding of distributed computing principles and performance optimization techniques.
Experience with configuration management and automation tools like Ansible or Puppet.
Familiarity with version control systems like Git and collaborative development platforms like GitHub.
Knowledge of SQL and scripting languages like Python for data manipulation and analysis.
Understanding of monitoring and logging tools such as ELK stack (Elasticsearch, Logstash, Kibana) or Splunk.
Experience with job scheduling and orchestration tools like Control-M, Oozie, or Airflow.
Should be willing to work on rotational shift
Should be willing to take on call supports
Specific Context
We are seeking a highly skilled and experienced Big Data Production Support Engineer to join our team. As the Production Support Engineer, you will be responsible for ensuring the stability, availability, and performance of our Big Data infrastructure and applications. Coordinate with cross-functional teams, and employ your technical expertise to anticipate and resolve production incidents.
Salary : As per industry standard.
Industry :IT-Software / Software Services
Functional Area : IT Software - Application Programming , Maintenance
VP- Engineering As a VP of Engineering, your responsibilities include leading and overseeing the entire engineering department. Develop and execute strategic plans, manage project portfolios, and ensure technical excellence. Foster a culture of innovation, mentor engineering teams, and align efforts with business objectives to drive successful product development and delivery.Build team and solutions from the scratch 20+ Years Products-Java, Spring Boot, Rest APIs, Multi threading, Data Structure
Data- Java, Python, Pandas, Pispark, Pitorch (optional), Airflow, Dealing big data, Pipelines. Da Extensive portfolio encompassing managerial roles, leading managers, recognized thought leader, possessing profound technical expertise, and demonstrating robust leadership across multiple portfolios. Clear and decisive in both strategic thinking and execution. Proficient in building products from inception to completion.Strategic thinking and clear articulation of thoughts
Responsibilities
Salary : As per industry standard.
Industry :IT-Software / Software Services
Functional Area : IT Software - Application Programming , Maintenance
