Skip to main content

Posts

Data Visualization

Data visualization is the strongest tool of what  we call exploratory data analysis. John Tukey, considered the father of exploratory data analysis once said, the greatest value of a picture  is when it forces us to notice what we never expected to see.  We note that many widely used data analysis  tools were initiated by discoveries made with exploratory data analysis.  Exploratory data analysis is perhaps the most important part of data analysis,  yet it is often overlooked.  Data visualization is also now pervasive and philanthropic  in educational organizations. One example comes from GAPminder and the talks, New Insights on Poverty  and the Best Stats You've Ever Seen, Hans Roslings  forced us to notice the unexpected with a series of plots  related to world health and economics. In his videos, he used animated graphs to show us how the world was changing,  and how old narratives are no longer true. It is also important to note that mistakes, biases, systematic errors,  and o...

Microservices Architecture and Preferred Design Pattern

Microservice Architecture and prefered Design Pattern Microservices are designed to offer greater agility and operational efficiency for the enterprises. My  goals and principles for a microservice architecture are Continuous and faster delivery through DevOps,  Built around business context (better business-developer coordination),  Reduced cost, Independently deployable, Decentralized, Small and maintainable code. Microservices is all about building around business domain or business context, creating decoupled code and making services loosely coupled, applying the single responsibility principle. A business context could be defined using DDD(domain driven design concept), It is something that a business does in order to generate value. A business context often corresponds to a business objective, e.g. Order Management is responsible for orders Customer Management is responsible for customers Decompose by Subdomain Decomposing an application using business ca...

Java HelloWorld with Gradle & Eclipse

To understand Gradle with Java build environment; this guide walks you through using Gradle to build a simple Java project. Follow the below link for details steps, I am summarizing some basic points to remember during this process.  https://spring.io/guides/gs/gradle/ Important notes : Java source folder in eclipse map to 'src/main/java/' and package starts from here imp file build.gradle it helps better management of dependencies, Jar files  $ ./gradlew build $ ./gradlew run Eclipse integration following this link https://www.vogella.com/tutorials/EclipseGradle/article.html The final version of :  build.gradle apply plugin : 'java' apply plugin : 'application' apply plugin : 'eclipse' mainClassName = 'hello.HelloWorld' sourceCompatibility = 1.8 targetCompatibility = 1.8 repositories { mavenCentral() } dependencies { compile " joda -time:joda-time:2.2" testCompile "junit:junit:4.12...

Installing up HomeBrew, NPM and Node.js

Installing HomeBrew Paste and run following on MacOS terminal or Linux shell prompt /bin/bash -c "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/master/install.sh )" Installation NPM and Node.js Installing Node.js® and NPM is pretty straightforward using Homebrew. Homebrew handles downloading, unpacking and installing Node and NPM on your system. The whole process (after you have Homebrew installed) should only take you a few minutes. Installation Steps Open the Terminal app  and type  brew update . This updates Homebrew with a list of the latest version of Node. **Type  brew install node . Sit back and wait.  Homebrew has to download some files and install them. But that's it. Test it! Make sure you have Node and NPM installed by running simple commands to see what version of each is installed: Test Node.  To see if Node is installed, type  node -v  in Terminal. This should print the version number so you'll see something like this  v0.10.31 . Test N...

DSLR Camera Exposure setting for solar eclipse

-- Deepesh Rajpal | c: 98282.38079 | rajpal.deepesh@gmail.com

Automatically run bash script with every restart of AWS EC2 instance

We will be using User Data script to define our autorun script, which we intend to execute on every reboot or launch of our EC2 instance. I will be using this script to mount my elastic file system drive (EFS) and start to do application server configuration every time my server is rebooted and auto-scale using my autoscaling configuration. To start here's little into of user data script. By default, user data scripts and cloud-init directives run only during the first boot cycle when an EC2 instance is launched. However, you can configure your user data script and cloud-init directives with a mime multi-part file. A mime multi-part file allows your script to override how frequently user data is executed in the cloud-init package. Then, the file executes the user script. For more information on mime multi-part files, see  Mime Multi Part Archive  on the cloud-init website. Example of User Data script:  Content-Type: multipart/mixed;...

EFS file mounting and startup script for EC2 linux instance

Put a script containing the command in your /etc directory. Create a script such as "startup.sh" using your favorite text editor. vi mystartup.sh # Mounting file system sudo mkdir efs sudo mount -t nfs4 -o nfsvers=4.1,rsize=1048576,wsize=1048576,hard,timeo=600,retrans=2,noresvport <efs_ip_here>:/ efs # Asking it to wait for 30 seconds before starting the server sleep 30 # Starting the tomcat server sudo /home/ec2-user/efs/Tomcat/bin/startup.sh Save the file in your /etc/init.d/ directory. sudo mv mystartup.sh /etc/init.d/ Change the permissions of the script (to make it executable) by typing  "chmod +x /etc/init.d/mystartup.sh". -- Deepesh Rajpal | c: 98282.38079 | rajpal.deepesh@gmail.com

Simple steps for starting with AWS

   Simple and Easy! Starting with AWS Free Tier Account     S      S           Scale Securely Adding a payment method to your AWS Account helps prevent fraud and keep your data safe.     Launch Unrestricted Accounts covered under the AWS Free Tier aren't restricted in what they can launch.     Transition Seamlessly ...

Improving Rest API Performance Using Cloudfront

With one of the clients from the healthcare industry, we were facing slow API response time causing bad user experience. Client technology integrates solving the lack of healthcare interoperability with its patient-centered mobile platform, from where patients can engage, communicate and participate in their healthcare across various providers that might be using different PM/EHR/EMR products. The product includes a SaaS platform for healthcare providers to share and communicate patient health information along with its cutting edge point-of-service patient check-in app for waiting rooms. Due to the complex nature of the product, one of the requirements of the product team was to solve this issue without changing a lot of existing code. The client had already evaluated a couple of paid tools that were working great but very costly, so another challenge was to find an open-source tool that can serve the purpose. Hence, we had a two-pronged challenge- Improve performance and reduce cost...