Senior Integration Consultant

Roles & Responsibilities:

Job Description:

Build data crawlers to extract data from customers' data sources using available ETL platforms, and troubleshoot the issues faced during data loading & processing
Design and build data warehouse models in columnar databases
Develop data processing scripts using SQL and be able to optimize complex sequences of SQL Queries
Design, build and deploy effective SSIS packages to validate, synthesize, transform customer data for integrated business planning and analytics
Work with Solution Architects to understand customers' business requirements and implement them
Perform data analysis for complex use cases using SQL document technical specification for
the cognitive applications that we are creating for the customers
Own the entire development and implementation workflow
Participate in the technical design, data requirements gathering and making recommendations on best practices, in case of inaccurate or missing data
Design and automate the data loading and insights generation process with intelligent checks and balances for sustained value delivery. Create and execute test plans, document issues and track progress at resolving issues.
Mandatory Skills:

Pyspark, Python, Airflow are mandatory (o9/Int3/SSIS – Good to have), API , ETL, Data warehousing Skills
Very strong hands-on experience working in Pyspark, ETL (Extract/Transform/Load) processes
Proficiency in databases (SQL Server, MySQL) and skills in one or more languages like SQL, MDX, T-SQL with knowledge of DDL, DML, stored procedures, triggers and performance tuning is a MUST
Familiarity with workflows in programming concepts
Experience using columnar databases
Experience working directly with customers and presenting your ideas
Excellent communication and presentation skills
Desirable Skills:

Applied Python programming
Experience working with JSON and XML files
Experience using APIs
Knowledge of SAP
Knowledge of supply chain fundamentals and terminology
Educational Qualifications & institutes to hire from:

Strong educational background from reputed engineering and management school