#Apache tear raw software

Worked in analyzingdatausing HiveQL and custom MapReduce programs.Involved in creating POCs to ingest and process streamingdatausing Spark and HDFS.Development ofPythonAPIs to dump teh array structures in teh Processor at teh failure point for debugging.Automation for execution of tests in batch usingShell scripting.Development of test framework using thePython.Wrapper developed inPythonfor instantiating multi-threaded application and running with other applications.DevelopedHive UDFsandPig UDFsusing Python in Microsoft HDInsight environment.Developed Spark scripts by using Scala Shell commands as per teh requirement.Importeddatafrom different sources like HDFS/Hbase to Spark RDD.Developed analytical components using Spark Scala and Spark Stream.Created hive schemas using performance techniques like partitioning and bucketing.Developed Scala scripts, UDF’s using bothDataframes/SQL and RDD/MapReduce in Spark forDataAggregation, queries and writingdataback into RDBMS through Sqoop.Internet Technologies: PHP, JSP, XML, HTML, CSS, JavaScriptĭatabase Technologies: PL/SQL, MySQL, Oracle Forms and Reports 9iīanking Systems: FLEXCUBE, Interfacing with GIW, TRANSACTOR Programming Languages: Java, C, PL SQL, Pig Latin, UNIX Shell Scripting, Python.

Hadoop Ecosystem: HDFS, Apache Spark, Scala, Kafka, Storm, Storm Streaming, Hive, Sqoop, Flume, Oozie, Zookeeper, Apache Hadoop Hadoop Distributed File System Replication Cloudera Cluster Apache Pig Map Reduce Cassandra, no SQL, MongoDB, SaaS, Power Center, Relational, hierarchical and graph databases, data federation and query optimizationīig data Platform: Cloudera Hadoop CDH 5.X, MapReduce (MRV1, MRV2/YARN), Hortonworks Sandbox

Proficiency in writing complex SQL queries and have Prevalent experience in Oracle RDBMS 10g, 11g design and developing Stored Procedures/packages, Triggers, Cursors using SQL and PL/SQL.Experience working in Cloudera and Hortonworks environments.Experience in working with various data formats like sequence file, Avro files, RC and ORC files and parquet files.ETL experience using Informatica Power center 9.x/10.x (Repository Admin, Rep Manager, Designer, Workflow Manager & Workflow monitor).Excellent noledge in MySQL and NoSQL Databases like HBase, Mongo DB and its Integration with Hadoop.Solid experience and understanding in VMs, UNIX, and Shell Scripting.3 + years of database administration experience using Oracle DBA 10g and11g databases like setup schemas, backup and recovery, setup database environments, Installation/configuration and Physical & Logical Data Modeling.2 + years of Data Modeling & Data Analysis experience using Dimensional Data Modeling and Relational Data Modeling.Hands on experience in utilizing Map Reduce programming model using Java for Batch processing of data stored away in HDFS.Experience working in tuple processing, writing data with Storm by provide Storm-Kafka connectors.Worked on user interface modules using HTML, JavaScript and Python.Understanding of stacking a streaming data straightforwardly into HDFS utilizing Flume and Spark Streaming.Solid experience in performing different Optimization techniques like distributed cache, map side joins, partitioning and bucketing.Experience in writing UDFs and UDAFs to extend functionality in Hive and PIG.Master in composing Hive QL queries and Pig Latin scripts for development and reporting.Experience working with Kafka on operational metrics, stream processing and logs aggregation.Working experience with Ingestion, Storage, Querying, Processing and Analysis of Big data using Hadoop environment and Apache Spark.Worked in large scale database environment like Hadoop MapReduce, with working mechanism of Hadoop clusters, nodes and Hadoop Distributed File System (HDFS).Experience working in Spark ecosystem using Spark Context, Spark-SQL, Data Frames and Pair RDD's to read/write different file formats.5 + years of experience in Hadoop 1.x/2.x, CDH3U6, HDFS, HBase, Spark, Sqoop 2.x, Scala, hive 0.7.1, Pig, Map reduce, Kafka, Flume, Java 1.6, Linux, Eclipse Juno, Impala, Oozie, XML, JSON, Maven, Zookeeper, Impala, and Hue.

#Apache tear raw software

8+ years of work experience in IT Industry in Analysis, Design, Development and Maintenance of various software applications mainly in Hadoop - Cloudera, Horton Works, Oracle (SQL, PL/SQL), Data Base Administrator in UNIX and Windows environments in industries like Banking, Financial, Pharmacies, Fixed Income, and Health Insurance.