Prediction is a key component of financial market modeling. In fact its an area where prediction can be applied directly. Risk/Return optimization is the other important aspect in financial market modeling but that is secondary to prediction. The third important aspect is pricing especially of derivative products with non-linear payoffs.
… Continue readingAI in Business Analytics
Automation is the biggest growth driver for any industry. Much work in being done in automation of various aspects of business: work flows, project management, marketing etc etc.. Business Analytics is lagging quite behind in this though. Much of business analytics today involves manual data munging, analysis by an expert, modeling through the use of statistical tools and a final decision making by a manger.… Continue reading
Fintech Revolution aka Unbundling of the Bank
Banks are entities with several disparate services. This has been for legacy reasons as people trusted banks for all money related business (except may be insurance). thus banks offer payments, deposits, loans, wealth and asset management, broking, custodial , transaction advisory, investment banking and other varied set of services.… Continue reading
Checklist for BigData
Looking to build a BigData platform? Here is an infrastructural checklist that you should build:
- Scalable structured DB (PotsgreSQL is a good choice)
- Scalable unstructured DB (MongoDB)
- Streaming data (Apache Storm)
- In-memory data processing (Apache SparkSQL and RDD)
- Machine learning (Spark MLLIB)
Also Python and associated libraries: although its not a big-data tool in itself python is a great language with readily available packages to interact with most big-data tools.… Continue reading
SQL.. NoSQL..WhateverQL..
Many proponents of NoSQL think that tables are so yester-century. Even in HTML Divs have replaced tables long time back for placing content on the page. Does that mean SQL will die down? May be, may be not..
Firstly there are several companies invested heavily in structured data solutions.… Continue reading
Why Python will takeover Java
The list of programming languages is practically infinite. But when it comes to latest web-based development and enterprise solutions three languages clearly lead: PHP, Java and Python. All of them have a C/C++ flavour in them. but they differ considerably in implementation, design and overall feel.… Continue reading
Cheap RAM is obviating the need for BigData Solutions
I read an interesting article on how cheaper RAM is making BigData solutions redundant. This thoughts has been playing in mind for sometime. There has been a big hype about BigData tools primarily because even running through several hundreds of GB in memory was becoming a problem, forget about terra and peta bytes of data.… Continue reading
Parallel Processing in Python
There has been much talk about hadoop and MapReduce. Map and reduce are not new concepts and have been in use for a long time (more than 50 years!) in functional programming. In-fact most embarrassingly parallel problems can be generalised using a parallel map function.… Continue reading
Its very highly likely you will not need Hadoop
- Do you have peta bytes of data (1,000,000 GB?)
- Are you willing to wait in long queues even before simple queries get answered?
- Are your computational requirements embarrassingly parallel?
If the answer to all of the above questions is “true” then sure go ahead with Hadoop.… Continue reading
BgiData Sans BigInsights
There is a whole lot of bragging about how data is growing and is changing the world. But ask any expert where it can be used and most of them give examples of using analytics and call that BigData use cases – predicting weather, calculating risk, doing trend analysis in diseases etc.… Continue reading
Analytics in a Box
Instead of selling data warehouse, analytics tools, reporting tools and analytics modeling services, data companies should build analytics as a product with industry level customization and sell the product. The product should have all the layers: data, analytics and reporting. In fact it will become even more attractive if the hardware is also clubbed into the offering.… Continue reading
Three-way Disconnect
When it comes to modeling and analytics, I believe that there is a three-way disconnect between research in institutions, technology companies and real businesses. When I say real businesses I don’t include social media and other such new age startups. I refer to companies providing tangible services.… Continue reading