tag:blogger.com,1999:blog-52244191017593560312023-11-15T05:34:51.936-08:00Cloudy MeatballAndrewhttp://www.blogger.com/profile/01723071506840447394noreply@blogger.comBlogger24125tag:blogger.com,1999:blog-5224419101759356031.post-84484322558572328492019-12-29T15:06:00.001-08:002019-12-29T15:06:52.311-08:00Cloudy mainframes in 2020So you have a mainframe you want to move to Azure Cloud?<br />
<br />
With the new <a href="https://us.nttdata.com/en/news/press-release/2019/december/ntt-microsoft">NTT and Microsoft Alliance</a> announced this month, look for interesting things to happen in this space and more in the coming months. <i><a href="https://www.photonics.com/Articles/PHI_Lab_Collaborates_on_Quantum_Neural/a65319">NTT Research opened its Palo Alto offices in July 2019 as a new Silicon Valley Startup.</a></i><br />
<br />
Some of the initiatives listed in the PR include:<br />
<br />
1. Global Digital Fabric.<br />
2. Cybersecurity threat intelligence analytics<br />
3. Social robotics with relational AI for digital companions<br />
4. Digital workpace solutions<br />
5. Knowledge discovery and management.<br />
6. All-photonics networks<br />
7. Digital twin computing<br />
8. Innovative Optical and Wireless Network (IOWN)<br />
9. Natural interactions between people, nature and technology.<br />
<br />
The <a href="https://www.nttdata.com/global/en/-/media/nttdataglobal/1_files/investors/annual-report/fy2019_ar_b.pdf">NTT DATA Group's 2019 Annual report </a>may shed some light on these initiatives.<br />
<br />
The PHI, CIS and MEI Labs within NTT Research are working with universities to research <i>hardware, materials and computational techniques. </i> <a href="https://www.ntt.co.jp/ir/library_e/presentation/2019/20190926_2.pdf">See this presentation on Quantum Computing </a>with some of these partners mentioned.<br />
<br />
What's Global Digital Fabric? I don't think it's <a href="https://us.nttdata.com/en/About-Us/Content/Wearable%20Tech%20for%20Better%20Health">nanotech shirts</a>, though they sound pretty game-changing for athletes and the medical industry. <a href="https://sg.channelasia.tech/article/669630/ntt-takes-enterprise-aim-microsoft-azure-preferred-cloud-platform/">According to this announcement</a>, it's combining Microsoft Azure with NTT's "globally-connected ICT infrastructure".<br />
<br />
Social robots will be fascinating. Robot companions could shadow you during sports, at home, in school, at a hospital or at work. Something as simple as a robot pet or insect gently reminding you about your prescriptions or monitoring your blood sugar could change many people's lives. A physical, interactive robot nagging you about your homework, guiding your studies and providing conversational AI for languages could change the way you learn.<br />
<br />
What if we could take a child's stuffed toy and use <a href="https://www.media.mit.edu/posts/making-new-robot-friends/">Relational AI and some motors </a>to turn it into a trusted teaching companion? Jacqueline Westlund's post on MIT's web site is really fascinating. There is an open-source <a href="https://docs.google.com/document/d/1e9wx9oBg7CR0s5O7YnYHVmX7H7pnITfoDxNdrSGkp60/edit#heading=h.tluu6g743n8w">MIT AI Ethics Education Curriculum available here</a>. Human-robot interaction (HRI) will be huge in 2020.<br />
<br />
All-photonics networks will accomodate "<a href="https://www.ntt.co.jp/mirai/e/organization/organization05/index.html">petabit-class scalable optical networks</a>". I can see AI & ML playing a big part in <a href="https://devblogs.nvidia.com/nvidia-real-time-noise-suppression-deep-learning/">reducing noise</a> and improving performance across large ranges. Intel, Sony and NTT<a href="https://optics.org/news/10/10/55"> announced an "innovation forum" called the Innovative Optical and Wireless Network (IWN) Global Forum</a> to accelerate R&D in this space.<br />
<br />
Speaking of noise reduction, I hope we see noise reduction home "appliances" emerge in 2020. Perhaps some active acoustic soundproofing foam which uses noise cancellation on a room-scale. Having that soundproof tunnel at home would be great for relaxation, concentration. Being able to cheaply control the acoustic properties of a room using some fabric or foam would be great for musicians and music aficionados.<br /><br />The topic of natural interactions between people, nature and technology is super-broad and could apply to many areas of study. The <a href="https://www.nttdata.com/global/en/about-us/company-profile/ai-guidelines">NTT DATA Group's AI Guidelines</a> provide some guidelines for transparency and understanding in AI. The <a href="https://www.nttdata.com/global/en/-/media/nttdataglobal/1_files/foresight/2019/fy2019_fo_fd.pdf">NTT DATA Technology Foresight 2019 highlights </a>predictions in areas such as XR Space (AR/VR/MR), brain tech, social and digital divides and many other topics. A great read towards 2020 tech.<br />
<br />
A <a href="https://www.ntt.co.jp/globalRD/pdf/NTTRD_Facts2018_03.pdf">2018 presentation on "corevo"</a> from NTT identifies 4 types of AI: Agent, Ambient, Heart-Touching, Network.<br />
<br />
It's the Heart-Touching AI's which excites me in 2020. <i> Analyzing people's minds and bodies to understand their deep psyche, their intellect, and their instincts.</i> Tech such as mind and body reading and bidirectional mind communication, emotional and tactile feedback loops will bring us closer to natural interactions with AI devices.<br />
<br />
Now back to old school computing, AzureCAT has you covered on the mainframe front with <i>Deploying NTT Data UniKix in Azure. </i><br />
<br />
<b>Part 1 Deploying the VM</b><br />
<a href="https://techcommunity.microsoft.com/t5/AzureCAT/Deploying-NTT-Data-UniKix-in-Azure-Part-1-Deploying-the-VM/ba-p/775840">https://techcommunity.microsoft.com/t5/AzureCAT/Deploying-NTT-Data-UniKix-in-Azure-Part-1-Deploying-the-VM/ba-p/775840</a><br />
<br />
<b>Part 2 - Configure TPE and compile the ACCT Application</b><br />
<a href="https://techcommunity.microsoft.com/t5/AzureCAT/Deploying-NTT-Data-UniKix-in-Azure-Part-2-Configure-TPE-and/ba-p/779142">https://techcommunity.microsoft.com/t5/AzureCAT/Deploying-NTT-Data-UniKix-in-Azure-Part-2-Configure-TPE-and/ba-p/779142</a><br />
<br />
<b>Open Mainframe Project</b><br />
<a href="https://github.com/openmainframeproject">https://github.com/openmainframeproject</a><br />
<a href="https://landscape.openmainframeproject.org/">https://landscape.openmainframeproject.org/</a><br />
<br />
<b>x3270 terminal emulator</b><br />
<a href="http://x3270.bgp.nu/">http://x3270.bgp.nu/</a><br />
<br />
I truly hope I am not on any Cobol projects in 2020.<br />
<br />Andrewhttp://www.blogger.com/profile/01723071506840447394noreply@blogger.com0tag:blogger.com,1999:blog-5224419101759356031.post-52585854560123606612019-10-30T12:40:00.002-07:002019-10-30T12:40:48.803-07:00Useful DOS commandsFrom the 80s to 2020, I find myself living more and more in DOS, Windows, Powershell, Bash/Zsh, Kube and Cloud shells, and looking forward to leveraging the new <a href="https://github.com/microsoft/terminal">Windows Terminal</a> once my work laptop gets upgraded.<br />
<br />
I appreciate the complexity and flexibility that Zsh has vs. DOS, and miss a lot of the features.<br />
<br />
Sometimes though, there are some interesting tricks I forget about when using DOS/Windows/Powershell.<br />
<br />
<b>Grab the history to a file. I always hit F7, and would appreciate having my session's file around for a basic command window.</b><br />
<b><br /></b>
doskey /HISTORY > history.txt<br />
<a href="https://www.howtogeek.com/298163/how-to-use-your-command-history-in-the-windows-command-prompt/">https://www.howtogeek.com/298163/how-to-use-your-command-history-in-the-windows-command-prompt/</a><br />
<br />
Also see Start Transcript<br />
<a href="https://4sysops.com/archives/powershell-transcript-record-a-session-to-a-text-file/">https://4sysops.com/archives/powershell-transcript-record-a-session-to-a-text-file/</a><br />
<br />
<b>Pipe a python script's output and stderr output</b><br />
python -m myscript.py &2>1<br />
<br />
<b>Teeing Objects</b><br />
<a href="https://adamtheautomator.com/tee-object-powershell/">https://adamtheautomator.com/tee-object-powershell/</a><br />
<br />
Ascii Doom<br />
<a href="https://dario-zubovic.itch.io/1337-doom">https://dario-zubovic.itch.io/1337-doom</a><br />
<br />
Last one should be cross-platform!Andrewhttp://www.blogger.com/profile/01723071506840447394noreply@blogger.com0tag:blogger.com,1999:blog-5224419101759356031.post-25596785478527142042019-10-28T18:29:00.000-07:002019-10-28T18:29:54.169-07:00Common Kubernetes Commands<br />
The Kubernetes Client kubectl <a href="https://blog.openshift.com/a-look-into-the-technical-details-of-kubernetes-1-16/">recently became an independent tool </a>outside of the main Kubernetes repo.<br />
<br />
Some common Kubernetes kubectl commands.<br />
<span style="background-color: white; color: #032f62; font-family: , "consolas" , "liberation mono" , "menlo" , monospace; font-size: 12px; white-space: pre;"><br /></span>
<span style="background-color: white; color: #032f62; font-family: , "consolas" , "liberation mono" , "menlo" , monospace; font-size: 12px; white-space: pre;"><a href="https://kubernetes.io/docs/reference/kubectl/overview/">https://kubernetes.io/docs/reference/kubectl/overview/</a></span><br />
<a href="https://github.com/kubernetes/kubectl/">https://github.com/kubernetes/kubectl/</a><br />
<a href="https://kubernetes.io/docs/reference/kubectl/cheatsheet/">https://kubernetes.io/docs/reference/kubectl/cheatsheet/</a><br />
<br />
Get the current cluster / namespace context<br />
<br />
kubectl config get-context<br />
<br />
Use the specified cluster context<br />
kubectl config use-context <i>my-cluster-name</i><br />
<br />
Which cluster am I on<br />
kubectl cluster-info<br />
<br />
Create my service/deployment/secret/configmap/replicationcontroller/pod/job<br />
kubectl apply -f <i>myyaml.yaml</i><br />
<br />
Delete the applied object(s)<br />
kubectl delete -f <i>myyaml.yaml</i><br />
<i><br /></i>
Delete a pod<br />
kubectl delete -n dev mydevpod<br />
<br />
Get a list of pods for all namespaces<br />
kubectl get pods -A<br />
<br />
Get the logs for a pod<br />
kubectl logs -n <i>dev mydevpod-abcde</i><br />
<br />
kubectl get internals<br />
<a href="https://github.com/kubernetes/kubernetes/blob/master/pkg/kubectl/cmd/get/get.go">https://github.com/kubernetes/kubernetes/blob/master/pkg/kubectl/cmd/get/get.go</a><br />
<br />
Copy files to a pod<br />
kubectl cp /tmp/foo_dir <some-pod>:/tmp/bar_dir<br />
<br />
Other commands<br />
<a href="https://github.com/kubernetes/kubernetes/blob/master/pkg/kubectl/cmd/cmd.go">https://github.com/kubernetes/kubernetes/blob/master/pkg/kubectl/cmd/cmd.go</a><br />
<br />
get, describe, delete, label, edit, patch, annotate, expose, scale, autoscale, taint, rollout, logs, exec, rolling-update, cordon, config use-context, config delete-cluster, cp<br />
<br />
kubectl get namespace<br />
kubectl config get-context<br />
kubectl config get-clusters<br />
kubectl config get-users<br />
<br />
<br />
<br />Andrewhttp://www.blogger.com/profile/01723071506840447394noreply@blogger.com0tag:blogger.com,1999:blog-5224419101759356031.post-65410019358950825452019-02-16T01:22:00.001-08:002019-02-16T01:22:10.531-08:00Microsoft Learning Resources and Restructuring Big DataMicrosoft has recently disrupted their learning paths and retired a number of exams. I am happy to have passed AZ-102 - Microsoft Azure Admin Certification Transition last year, while it was in beta. <br />
<br />
A number of exams have been retired recently or are set to retire.<br />
<a href="https://buildazure.com/2018/12/21/microsoft-exams-scheduled-to-retire-in-early-2019/">https://buildazure.com/2018/12/21/microsoft-exams-scheduled-to-retire-in-early-2019/</a><br />
<br />
Microsoft is <a href="https://www.edx.org/course?search_query=microsoft">leveraging edX</a> for its Microsoft Professional and Capstone tracks. Pick a topic and go.<br />
<br />
<a href="https://mva.microsoft.com/">Microsoft Virtual Academy</a> is going away and being replaced with <a href="https://docs.microsoft.com/en-us/learn/">Microsoft Learn</a>. What's great about learn is that it provides a no-cost sandbox in Azure for learning, directly in the labs! Microsoft is pursuing developer adoption, and developers have concerns with their credit cards and cloud services. A former colleague of mine rang up a large bill in Amazon after leaving on some Hadoop clusters he was using for training. This fear of costs and the pay-as-you-go model will continue to limit the cloud experience for entry-level developers.<br />
<br />
Speaking of cost containment, it is 2019 and <a href="https://feedback.azure.com/forums/217335-hdinsight/suggestions/5663773-start-stop-cluster-hdinsight">we still can't pause HDInsight clusters....</a> I think that this feature alone would "Spark" increased growth of Hadoop on Azure. Azure Databricks and its job-based cluster model seems to have the right approach, and the friction of spinning up and pausing clusters is much less than in HDInsight. <br />
<br />
With Databricks being the <a href="https://databricks.com/company/newsroom/press-releases/databricks-ranked-a-fastest-growing-company-in-north-america-on-deloittes-2018-technology-fast-500">fastest growing company in North America</a>, I see adoption of Cloudera (+ the former Hortonworks) and HDInsight in the cloud continuing to increase. The vast zoo of services between Hortonworks Data Platform (HDP) and Cloudera Data Platform (CDP) being combined and deprecated will make for an interesting gene pool.<br />
<br />
And all will sit on <a href="https://docs.microsoft.com/en-us/azure/storage/blobs/data-lake-storage-introduction">Azure Data Lake Gen2 Blob Storage</a>? Microsoft marketing needs a better name than hierarchial namespace for their game-changing big-data filesystem....<br />
<br />
<a href="https://jira.apache.org/jira/browse/HADOOP-15407">When Apache and Microsoft worlds collide</a> - there are some amazing code reviews coming out of those JIRA tickets where companies such as Microsoft enter the open-source arena.<br />
<br />
<a href="https://www.edx.org/xseries/microsoft-azure-hdinsight-big-data">Microsoft Azure HDInsight Big Data Analyst</a><br />
<br />
<br />
<br />
<br />Andrewhttp://www.blogger.com/profile/01723071506840447394noreply@blogger.com0tag:blogger.com,1999:blog-5224419101759356031.post-17438325814677647502018-10-26T03:33:00.000-07:002018-10-26T03:33:59.795-07:00Azure CosmosDB Resources<br />
A few links to assist with CosmosDB<br />
<br />
CosmosDB Indexes<br />
<br />
<a href="http://muratbuffalo.blogspot.com/2018/08/logical-index-organization-in-cosmos-db.html?utm_content=78727690&utm_medium=social&utm_source=twitter">http://muratbuffalo.blogspot.com/2018/08/logical-index-organization-in-cosmos-db.html?utm_content=78727690&utm_medium=social&utm_source=twitter</a><br />
<br />
CosmosDB Cheat Sheets<br />
<a href="https://docs.microsoft.com/en-us/azure/cosmos-db/query-cheat-sheet?WT.mc_id=twitter&utm_content=78509449&utm_medium=social&utm_source=twitter">https://docs.microsoft.com/en-us/azure/cosmos-db/query-cheat-sheet?WT.mc_id=twitter&utm_content=78509449&utm_medium=social&utm_source=twitter</a><br />
<br />
CosmosDB Like A Pro<br />
<a href="https://medium.com/@david.nissimoff/azure-cosmos-db-like-a-pro-minimize-cost-maximize-productivity-24dfee205c0">https://medium.com/@david.nissimoff/azure-cosmos-db-like-a-pro-minimize-cost-maximize-productivity-24dfee205c0</a><br />
<br />
CosmosDB Ignite 2018 Sessions<br />
<a href="https://www.youtube.com/playlist?list=PLmamF3YkHLoLkL4Q-fRgbG8URj503ZMgd">https://www.youtube.com/playlist?list=PLmamF3YkHLoLkL4Q-fRgbG8URj503ZMgd</a>Andrewhttp://www.blogger.com/profile/01723071506840447394noreply@blogger.com0tag:blogger.com,1999:blog-5224419101759356031.post-74069988195766904102018-05-14T19:50:00.001-07:002018-05-14T19:50:52.215-07:00Durable Functions goes GAAzure Durable Functions is an extension of Azure Functions and Azure WebJobs for managing state, checkpoints, and restarts.<br />
<ul>
<li>They can checkpoint on await and maintain state</li>
<li>They can orchestrate other functions</li>
<li>They define workflows as code. </li>
</ul>
There are some complex problems that can be solved by leveraging durable functions, including processes requiring manual intervention.<br />
<br />
Be sure to view the release notes and open issues to make sure durable extensions will work in your scenario.<br />
<br />
<a href="https://github.com/Azure/azure-functions-durable-extension/releases/tag/v1.4.0">https://github.com/Azure/azure-functions-durable-extension/releases/tag/v1.4.0</a><a href="https://github.com/Azure/azure-functions-durable-extension/issues">https://github.com/Azure/azure-functions-durable-extension/issues</a><div>
</div>
Andrewhttp://www.blogger.com/profile/01723071506840447394noreply@blogger.com0tag:blogger.com,1999:blog-5224419101759356031.post-28263119410180380982017-01-21T06:24:00.001-08:002017-01-21T06:24:28.715-08:00Azure DocumentDB Emulator ReleasedAzure DocumentDB Emulator was released late last year. It provides an on-premise way of testing DocumentDB databases without spinning up a DocumentDB service in Azure. Based on the comments thread it is a bit unstable, yet there is still plenty of interest. <br />
<br />
Most enterprise organizations and developers doing testing against cloud services require on-premise versions of those services. This simplifies development, reduces latency instead of connecting to cloud resources, and reduces costs. For customers using on-premise builds, it is vital to making sure that all builds and tests are contained in their own silo.<br />
<br />
<a href="https://docs.microsoft.com/en-us/azure/documentdb/documentdb-nosql-local-emulator">https://docs.microsoft.com/en-us/azure/documentdb/documentdb-nosql-local-emulator</a><br />
<br />
Comparison of HBase, MongoDB and DocumentDB<br />
<a href="http://db-engines.com/en/system/HBase%3BMicrosoft+Azure+DocumentDB%3BMongoDB">http://db-engines.com/en/system/HBase%3BMicrosoft+Azure+DocumentDB%3BMongoDB</a><br />
<br />
DocumentDB provides protocol support for any apps written to use MongoDB to convert MongoDB servers to a PaaS Azure model. Some features such as aggregation pipelines are not yet available.<br />
<a href="https://docs.microsoft.com/en-us/azure/documentdb/documentdb-protocol-mongodb">https://docs.microsoft.com/en-us/azure/documentdb/documentdb-protocol-mongodb</a><br />
<br />
DocumentDB has been around since 2014, however MongoDB is still the beast in its category.<br />
<a href="http://db-engines.com/en/ranking/document+store">http://db-engines.com/en/ranking/document+store</a><br />
<br />
An intro to DocumentDB<br />
<a href="https://docs.microsoft.com/en-us/azure/documentdb/documentdb-introduction">https://docs.microsoft.com/en-us/azure/documentdb/documentdb-introduction</a><br />
<br />
Analyze data with HDInsight and DocumentDB<br />
<a href="https://docs.microsoft.com/en-us/azure/documentdb/documentdb-run-hadoop-with-hdinsight">https://docs.microsoft.com/en-us/azure/documentdb/documentdb-run-hadoop-with-hdinsight</a><br />
<br />
The MongoDB Spark Connector<br />
<a href="https://github.com/mongodb/mongo-spark">https://github.com/mongodb/mongo-spark</a><br />
<br />
DocumentDB as a device registration store for Azure IoT Hub<br />
<a href="https://docs.microsoft.com/en-us/azure/iot-suite/iot-suite-what-are-preconfigured-solutions">https://docs.microsoft.com/en-us/azure/iot-suite/iot-suite-what-are-preconfigured-solutions</a><br />
<br />
I'm still looking for a good way to do on-premise Azure Data Factory tests for simulating pipelines.... just upvoted Support MSBuild...<br />
<br />
<a href="https://feedback.azure.com/forums/270578-azure-data-factory?filter=new&page=4">https://feedback.azure.com/forums/270578-azure-data-factory?filter=new&page=4</a>Andrewhttp://www.blogger.com/profile/01723071506840447394noreply@blogger.com0tag:blogger.com,1999:blog-5224419101759356031.post-19339949675759716662017-01-10T04:37:00.000-08:002017-01-10T04:37:32.797-08:00Awesome Awesomeness Lists including Cloud, IoT and MobileA few resources for mobile devices, REST APIs and other awesome awesomeness lists.<br />
<br />
Awesome Mobile UI/UX Interfaces<br />
<a href="https://github.com/cymcsg/Awesome-Mobile-UI">https://github.com/cymcsg/Awesome-Mobile-UI</a><br />
<br />
Awesome API<br />
<a href="https://github.com/Kikobeats/awesome-api">https://github.com/Kikobeats/awesome-api</a><br />
<br />
Awesome IoT<br />
<a href="https://github.com/HQarroum/awesome-iot">https://github.com/HQarroum/awesome-iot</a><br />
<br />
Simulate Popular Mobile Devices for Testing<br />
<a href="https://www.asp.net/mobile/device-simulators">https://www.asp.net/mobile/device-simulators</a><br />
<br />
Mobile Dev Learning<br />
<a href="https://github.com/MakinGiants/awesome-android-learner">https://github.com/MakinGiants/awesome-android-learner</a><br />
<br />
Awesome Awesomeness List<br />
<a href="https://github.com/bayandin/awesome-awesomeness">https://github.com/bayandin/awesome-awesomeness</a><br />
<br />
Curated List of Awesome Lists<br />
<a href="https://github.com/sindresorhus/awesome">https://github.com/sindresorhus/awesome</a><br />
<br />
The Viral Progressive Web App<br />
<a href="https://cloudfour.com/thinks/the-business-case-for-progressive-web-apps/">https://cloudfour.com/thinks/the-business-case-for-progressive-web-apps/</a><br />
<br />
Progressive Apps<br />
<a href="https://infrequently.org/2015/06/progressive-apps-escaping-tabs-without-losing-our-soul/">https://infrequently.org/2015/06/progressive-apps-escaping-tabs-without-losing-our-soul/</a><br />
<br />
Service Workers<br />
<a href="https://developers.google.com/web/fundamentals/getting-started/primers/service-workers">https://developers.google.com/web/fundamentals/getting-started/primers/service-workers</a><br />
<br />
Getting Started with WebVR<br />
<a href="https://developers.google.com/web/fundamentals/vr/getting-started-with-webvr/">https://developers.google.com/web/fundamentals/vr/getting-started-with-webvr/</a>Andrewhttp://www.blogger.com/profile/01723071506840447394noreply@blogger.com0tag:blogger.com,1999:blog-5224419101759356031.post-23934571651281542372016-12-02T04:37:00.001-08:002016-12-02T04:37:33.541-08:00Azure HDInsight Apps & Domain-Joined Premium HDInsight ClustersUp until recently, HDInsight had a separate security model from Azure AD. Microsoft has <a href="https://docs.microsoft.com/en-in/azure/hdinsight/hdinsight-domain-joined-introduction">introduced Domain-Joined HDInsight cluster</a>s, which brings authentication with Azure AD & <a href="https://docs.microsoft.com/en-in/azure/hdinsight/hdinsight-domain-joined-configure-use-powershell">authorization with Apache Ranger to HDInsight</a>. Currently this feature is part of Premium HDInsight, and <a href="https://docs.microsoft.com/en-in/azure/hdinsight/hdinsight-domain-joined-run-hive">supports Hive</a>, though you should be able to install/custom configure other applications.<br />
<br />
<span style="font-family: inherit;">When spinning up an Azure HDInsight cluster, there are a few options during setup, including adding <a href="https://github.com/Microsoft/azure-docs/blob/master/articles/hdinsight/hdinsight-apps-install-applications.md">marketplace apps</a> from 3rd-party vendors.</span><br />
<span style="font-family: inherit;"><br /></span>
<span style="font-family: inherit;">The blurb from the install screen.</span><br />
<h3>
<span style="font-family: inherit;">External Apps</span></h3>
<ul style="box-sizing: border-box; color: #333333; font-size: 16px; margin-bottom: 16px; margin-top: 0px; padding-left: 2em;">
<li style="box-sizing: border-box;"><span style="font-family: inherit;"><span style="box-sizing: border-box; font-weight: 600;">Datameer</span>: <a href="http://www.datameer.com/documentation/display/DAS50/Home?ls=Partners&lsd=Microsoft&c=Partners&cd=Microsoft" style="box-sizing: border-box; color: #4078c0; text-decoration: none;">Datameer</a> offers analysts an interactive way to discover, analyze, and visualize the results on Big Data. Pull in additional data sources easily to discover new relationships and get the answers you need quickly.</span></li>
<li style="box-sizing: border-box; margin-top: 0.25em;"><span style="font-family: inherit;"><span style="box-sizing: border-box; font-weight: 600;">Streamsets Data Collector for HDnsight</span> provides a full-featured integrated development environment (IDE) that lets you design, test, deploy, and manage any-to-any ingest pipelines that mesh stream and batch data, and include a variety of in-stream transformations—all without having to write custom code.</span></li>
<li style="box-sizing: border-box; margin-top: 0.25em;"><span style="font-family: inherit;"><span style="box-sizing: border-box; font-weight: 600;">Cask CDAP 3.5 for HDInsight</span> provides the first unified integration platform for big data that cuts down the time to production for data applications and data lakes by 80%. This application only supports Standard HBase 3.4 clusters.</span></li>
</ul>
<div>
<span style="font-family: inherit;">More info on each of these.</span></div>
<div>
<span style="font-family: inherit;"><br /></span></div>
<div>
<span style="font-family: inherit;">Datameer is a data ingest, transformation, and visualization tool. Connects to <a href="https://www.datameer.com/documentation/display/DAS50/Types+of+Data+Supported">tons of sources, </a>including cloud-based, on-prem, relational, nosql, and even Cobol. </span></div>
<div>
<span style="font-family: inherit;">There's a built-in plugin to export to a Tableau Server.</span></div>
<div>
<a href="http://www.datameer.com/documentation/display/DAS50/Hadoop+and+Datameer"><span style="font-family: inherit;">http://www.datameer.com/documentation/display/DAS50/Hadoop+and+Datameer</span></a></div>
<div>
<span style="font-family: inherit;"><br /></span></div>
<div>
<span style="font-family: inherit;">Streamsets Data Collector, for building data pipelines and providing operational dashboards.</span></div>
<div>
<a href="https://streamsets.com/products/"><span style="font-family: inherit;">https://streamsets.com/products/</span></a></div>
<div>
<span style="font-family: inherit;"><br /></span></div>
<div>
<span style="font-family: inherit;">Cask CDAP</span></div>
<div>
<a href="http://cask.co/products/cdap/"><span style="font-family: inherit;">http://cask.co/products/cdap/</span></a></div>
<div>
<span style="font-family: inherit;"><br /></span></div>
<div>
<span style="font-family: inherit;">Each of the applications have specific requirements for the version of HDInsight / HDP that will be used and additional configuration within the applications themselves.</span></div>
<h3>
<span style="font-family: inherit;">Custom Apps</span></h3>
<div>
<span style="font-family: inherit;">In addition to the apps in the Azure Marketplace, you can install custom applications, one way is by using shell actions. </span></div>
<div>
<span style="font-family: inherit;"><br /></span></div>
<div>
<span style="font-family: inherit;">Some resources for installing custom applications with Azure HDInsight.</span></div>
<a href="https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-apps-install-custom-applications"><span style="font-family: inherit;">https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-apps-install-custom-applications</span></a><br />
<span style="font-family: inherit;"><br /></span>
<div style="font-size: 11pt; margin: 0in;">
<span style="font-family: inherit;">HDInsight provides
several scripts to install the following components on HDInsight clusters:</span></div>
<div style="direction: ltr;">
<table border="1" cellpadding="0" cellspacing="0" style="border-collapse: collapse; border-color: #A3A3A3; border-style: solid; border-width: 1pt; direction: ltr;" valign="top">
<tbody>
<tr>
<td style="background-color: white; border-color: #A3A3A3; border-style: solid; border-width: 1pt; padding: 4pt 4pt 4pt 4pt; vertical-align: top; width: 1.284in;">
<div style="color: #222222; font-size: 11pt; margin: 0in;">
<span style="font-family: inherit;">Name</span></div>
</td>
<td style="background-color: white; border-color: #A3A3A3; border-style: solid; border-width: 1pt; padding: 4pt 4pt 4pt 4pt; vertical-align: top; width: 6.4562in;">
<div style="color: #222222; font-size: 11pt; margin: 0in;">
<span style="font-family: inherit;">Script</span></div>
</td>
</tr>
<tr>
<td style="background-color: white; border-color: #A3A3A3; border-style: solid; border-width: 1pt; padding: 4pt 4pt 4pt 4pt; vertical-align: top; width: 1.284in;">
<div style="color: #222222; font-size: 11pt; margin: 0in;">
<span style="font-weight: bold;"><span style="font-family: inherit;">Install Spark</span></span></div>
</td>
<td style="background-color: white; border-color: #A3A3A3; border-style: solid; border-width: 1pt; padding: 4pt 4pt 4pt 4pt; vertical-align: top; width: 6.4562in;">
<div style="font-size: 11pt; margin: 0in;">
<span style="font-family: inherit;"><a href="https://hdiconfigactions.blob.core.windows.net/sparkconfigactionv03/spark-installer-v03.ps1"><span lang="en-US">https://hdiconfigactions.blob.core.windows.net/sparkconfigactionv03/spark-installer-v03.ps1</span></a><span lang="en-US" style="color: #222222;">. See</span><span lang="en-CA" style="color: #222222;"> </span><a href="https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-spark-install"><span lang="en-CA">Install and use Spark on HDInsight clusters</span></a><span lang="en-US" style="color: #222222;">.</span></span></div>
</td>
</tr>
<tr>
<td style="background-color: white; border-color: #A3A3A3; border-style: solid; border-width: 1pt; padding: 4pt 4pt 4pt 4pt; vertical-align: top; width: 1.284in;">
<div style="color: #222222; font-size: 11pt; margin: 0in;">
<span style="font-weight: bold;"><span style="font-family: inherit;">Install R</span></span></div>
</td>
<td style="background-color: white; border-color: #A3A3A3; border-style: solid; border-width: 1pt; padding: 4pt 4pt 4pt 4pt; vertical-align: top; width: 6.4562in;">
<div style="font-size: 11pt; margin: 0in;">
<span style="font-family: inherit;"><a href="https://hdiconfigactions.blob.core.windows.net/rconfigactionv02/r-installer-v02.ps1"><span lang="en-US">https://hdiconfigactions.blob.core.windows.net/rconfigactionv02/r-installer-v02.ps1</span></a><span lang="en-US" style="color: #222222;">. See</span><span lang="en-CA" style="color: #222222;"> </span><a href="https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-r-scripts"><span lang="en-CA">Install and use R on HDInsight clusters</span></a><span lang="en-US" style="color: #222222;">.</span></span></div>
</td>
</tr>
<tr>
<td style="background-color: white; border-color: #A3A3A3; border-style: solid; border-width: 1pt; padding: 4pt 4pt 4pt 4pt; vertical-align: top; width: 1.284in;">
<div style="color: #222222; font-size: 11pt; margin: 0in;">
<span style="font-weight: bold;"><span style="font-family: inherit;">Install Solr</span></span></div>
</td>
<td style="background-color: white; border-color: #A3A3A3; border-style: solid; border-width: 1pt; padding: 4pt 4pt 4pt 4pt; vertical-align: top; width: 6.4562in;">
<div style="font-size: 11pt; margin: 0in;">
<span style="font-family: inherit;"><a href="https://hdiconfigactions.blob.core.windows.net/solrconfigactionv01/solr-installer-v01.ps1"><span lang="en-US">https://hdiconfigactions.blob.core.windows.net/solrconfigactionv01/solr-installer-v01.ps1</span></a><span lang="en-US" style="color: #222222;">. See</span><span lang="en-CA" style="color: #222222;"> </span><a href="https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-solr-install"><span lang="en-CA">Install and use Solr on HDInsight clusters</span></a><span lang="en-US" style="color: #222222;">.</span></span></div>
</td>
</tr>
<tr>
<td style="background-color: white; border-color: #A3A3A3; border-style: solid; border-width: 1pt; padding: 4pt 4pt 4pt 4pt; vertical-align: top; width: 1.284in;">
<div style="color: #222222; font-size: 11pt; margin: 0in;">
<span style="font-family: inherit;"><span lang="en-US">-</span><span lang="en-CA"> </span><span lang="en-CA" style="font-weight: bold;">Install Giraph</span></span></div>
</td>
<td style="background-color: white; border-color: #A3A3A3; border-style: solid; border-width: 1pt; padding: 4pt 4pt 4pt 4pt; vertical-align: top; width: 6.4562in;">
<div style="font-size: 11pt; margin: 0in;">
<span style="font-family: inherit;"><a href="https://hdiconfigactions.blob.core.windows.net/giraphconfigactionv01/giraph-installer-v01.ps1"><span lang="en-US">https://hdiconfigactions.blob.core.windows.net/giraphconfigactionv01/giraph-installer-v01.ps1</span></a><span lang="en-US" style="color: #222222;">. See</span><span lang="en-CA" style="color: #222222;"> </span><a href="https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-giraph-install"><span lang="en-CA">Install and use Giraph on HDInsight clusters</span></a><span lang="en-US" style="color: #222222;">.</span></span></div>
</td>
</tr>
<tr>
<td style="background-color: white; border-color: #A3A3A3; border-style: solid; border-width: 1pt; padding: 4pt 4pt 4pt 4pt; vertical-align: top; width: 1.284in;">
<div style="color: #222222; font-size: 11pt; margin: 0in;">
<span style="font-weight: bold;"><span style="font-family: inherit;">Pre-load Hive libraries</span></span></div>
</td>
<td style="background-color: white; border-color: #A3A3A3; border-style: solid; border-width: 1pt; padding: 4pt 4pt 4pt 4pt; vertical-align: top; width: 6.4562in;">
<div style="font-size: 11pt; margin: 0in;">
<span style="font-family: inherit;"><a href="https://hdiconfigactions.blob.core.windows.net/setupcustomhivelibsv01/setup-customhivelibs-v01.ps1"><span lang="en-US">https://hdiconfigactions.blob.core.windows.net/setupcustomhivelibsv01/setup-customhivelibs-v01.ps1</span></a><span lang="en-US" style="color: #222222;">. See</span><span lang="en-CA" style="color: #222222;"> </span><a href="https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-add-hive-libraries"><span lang="en-CA">Add Hive libraries on HDInsight clusters</span></a></span></div>
</td>
</tr>
</tbody></table>
</div>
<div lang="en-CA" style="font-size: 11pt; margin: 0in;">
<br /></div>
<div style="color: #595959; font-size: 9pt; margin: 0in;">
<span style="font-family: inherit;">From
<<a href="https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-customize-cluster">https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-customize-cluster</a>>
</span></div>
<br />
<div lang="en-CA" style="font-size: 11pt; margin: 0in;">
<br /></div>
<span style="font-family: inherit;">Installing the script action for Hue and some other components will restart the HDInsight cluster services, rendering the server unavailable for jobs.</span><br />
<span style="font-family: inherit;"><br /></span>
<h3>
<span style="font-family: inherit;">Bootstrapping Config Files</span></h3>
<div>
<span style="font-family: inherit;">If you download configs through Ambari or from command-line, you can provision new clusters with changed configuration files.</span></div>
<div>
<a href="https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-customize-cluster-bootstrap">https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-customize-cluster-bootstrap</a></div>
<h3>
<span style="font-family: inherit;">Connectivity</span></h3>
<span style="font-family: inherit;"><a href="https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-linux-use-ssh-windows">Connecting to the cluster using ssh</a></span><br />
<span style="font-family: inherit;"><br /></span>
<span style="font-family: inherit;">Working with HD Insight, Hue and many of the other browser-based tools sometimes requires <a href="https://github.com/Microsoft/azure-docs/blob/master/articles/hdinsight/hdinsight-linux-ambari-ssh-tunnel.md">Setting up SSH tunneling</a>, if you don't have access directly to HDInsight network.</span><br />
<span style="font-family: inherit;"><br /></span>
<span style="font-family: inherit;">You can avoid this by setting up some edge nodes in the cluster.</span><br />
<span style="font-family: inherit;"><a href="https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-apps-use-edge-node">https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-apps-use-edge-node</a></span><br />
<br />
Extending the network is also useful. When provisioning an HDInsight cluster, you can assign it to a VNet.<br />
<a href="https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-extend-hadoop-virtual-network">https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-extend-hadoop-virtual-network</a><br />
<span style="font-family: inherit;"><br /></span>
<h3>
<span style="font-family: inherit;">RStudio & RevoR</span></h3>
<span style="font-family: inherit;"><span style="background-color: white; color: #000305; font-size: 14px;">Rikard Sandström has some helpful links - i</span>nstalling a Premium HDInsight Spark cluster with <a href="https://rsandstroem.github.io/rstudioazure.html">RStudio + Tunnel</a> and <a href="https://rsandstroem.github.io/azurehdinsighttemplate.html">Creating HDInsight Clusters with Templates</a>.</span><br />
<span style="font-family: inherit;"><br /></span>
<h3>
</h3>
<span style="font-family: inherit;"><br /></span>
<br />
<span style="font-family: inherit;"><br /></span>
<br />
<br />
<span style="font-family: inherit;"><br /></span>
<br />Andrewhttp://www.blogger.com/profile/01723071506840447394noreply@blogger.com0tag:blogger.com,1999:blog-5224419101759356031.post-91178463141117030942016-05-31T20:05:00.000-07:002016-05-31T20:05:21.633-07:00ChatOps and Azure ResourcesWorking with Azure this week, I setup a few Azure Logic Apps to send messages from Twitter to Slack using <a href="https://zapier.com/zapbook/slack/windows-azure-web-sites/">Zapier</a>, Very interesting use case for using up your Slack message limits. :) Similar functionality exists(ed) with Yahoo Pipes (RIP), ITTT and other web 2.0 integration tools, this one is great since it can live inside a protected Azure network, is relatively simple to setup with a visual designer, and lets you upsize to Biztalk functionality for BPM activities.<br />
<br />
Slack seems to be the method of choice for many firms coming back to the '90s realm of IRC, with persisted chat windows, ChatOps continuous integration and automated deployments. Companies like Shopify use it for their deployments activities and for their customers feature stories. <br />
<br />
The ability to do <a href="http://fabriccontroller.net/chatops-deploy-and-manage-complete-environments-on-azure-using-slack/">ChatOps</a> activities, <a href="http://www.abdurrachman-habibi.com/integrating-azure-deployment-to-azure/">wire up deployment commands and notification messages </a>in Slack is really cool.<br />
<br />
Not to be late to the party, Microsoft introduced /skype integration with Slack in the new year.<br />
<a href="https://www.skype.com/en/features/slack/">https://www.skype.com/en/features/slack/</a> The motto of Microsoft in 2016 seems to be if you can't beat 'em... hang out with them.<br />
<br />
Coming back to Azure with a _few_ resources, an enormous amount of Azure shortcuts here.<br />
<a href="https://blogs.technet.microsoft.com/tangent_thoughts/2016/02/04/bookmark-this-aka-msazureshortcuts/">https://blogs.technet.microsoft.com/tangent_thoughts/2016/02/04/bookmark-this-aka-msazureshortcuts/</a><br />
<br />
The Azure ML Learning Cheat Sheet<br />
<a href="https://azure.microsoft.com/en-us/documentation/articles/machine-learning-algorithm-cheat-sheet/">https://azure.microsoft.com/en-us/documentation/articles/machine-learning-algorithm-cheat-sheet/</a><br />
<br />
The Azure Web Sites (Web Apps?) Cheat Sheet<br />
<a href="http://microsoftazurewebsitescheatsheet.info/">http://microsoftazurewebsitescheatsheet.info/</a><br />
<br />
A Complete List of Microsoft Azure Tools<br />
<a href="http://scottge.net/2015/08/03/a-complete-list-of-microsoft-azure-tools/">http://scottge.net/2015/08/03/a-complete-list-of-microsoft-azure-tools/</a><br />
<br />
With Microsoft Canada adding its new data centres and ExpressRoute functionality, it's an exciting time to be a cloud developer above the 49th parallel north.<br />
<br />
<br />Andrewhttp://www.blogger.com/profile/01723071506840447394noreply@blogger.com0tag:blogger.com,1999:blog-5224419101759356031.post-5144370557359075112012-06-13T02:57:00.001-07:002012-06-13T02:57:20.761-07:00Meet the New Windows Azure - ScottGu's BlogScott Guthrie announces full VM support in Windows Azure. Host your VMs, Linux, Windows, DOS in the cloud.<br />
<br />
Now if they had a VM to VHD converter they may get even more traction.<br />
<br />
<em>Windows Azure now allows you to deploy up to 10 web-sites into a <u><strong>free</strong></u>, shared/multi-tenant hosting environment (where a site you deploy will be one of multiple sites running on a shared set of server resources). This provides an easy way to get started on projects at no cost.</em><br />
<br />
Microsoft has gone and given away free hosting.<br />
<br />
Lots more features here.<br />
<br />
<a href="http://weblogs.asp.net/scottgu/archive/2012/06/07/meet-the-new-windows-azure.aspx">Meet the New Windows Azure - ScottGu's Blog</a>Andrewhttp://www.blogger.com/profile/01723071506840447394noreply@blogger.com0tag:blogger.com,1999:blog-5224419101759356031.post-76357696762787401732012-05-02T12:34:00.001-07:002012-05-02T12:34:08.393-07:00Crowdsourcing and Cloud Labor<p>Technology isn’t the only thing contained in the cloud. There are people floating around in there too. </p> <p>One of the challenges with natural learning, neural networks and text analysis is the ability to categorize an opinion context. Using a lexicon of various terms, and the syntax of the terms in a statement, you can do a general categorization. However, what’s to say that “you’re so dumb” and “you’re SO dumb” mean the same thing. The one with capitals could be a sarcastic comment, depending on the context.</p> <p>We can do some general analysis of text terms, however manually tagging these may prove to be more accurate. How do you setup a manual tagging job using real labor?</p> <blockquote><em>CrowdFlower’s system leverages large groups of workers to solve massive but technically simple tasks. One of these services is sentiment analysis, the study of public opinion on a given subject. Other sentiment analysis programs use computational linguistics to perform this task, but computers cannot always discern nuances of tone, such as sarcasm or irony. <strong>CrowdFlower’s version is unique in that actual humans perform the sentiment analysis.</strong></em></blockquote> <p><a href="http://blog.crowdflower.com/2012/03/what-motivates-crowdsource-workers-on-crowdflower-kaggle-highlights-of-sxsw-2012s-pay-or-play-crowdsourcing-talk/#more-5211">What Motivates Crowdsource Workers on CrowdFlower & Kaggle – Highlights of SXSW 2012′s “Pay or Play” Crowdsourcing Talk | The CrowdFlower Blog</a></p> <p>Sounds interesting!</p> Andrewhttp://www.blogger.com/profile/01723071506840447394noreply@blogger.com0tag:blogger.com,1999:blog-5224419101759356031.post-2027386754065983782012-04-09T07:52:00.001-07:002012-04-09T07:52:02.687-07:00SSIS Junkie : AdventureWorks2012 now available for all on SQL Azure<p>Why not host your training platforms in the cloud? It only makes sense, especially for databases, as every developer doesn’t need the latest Adventureworks database on their laptop, and it’s a big waste to add to a local server.</p> <blockquote><em>AdventureWorks2012 now available for all on SQL Azure</em></blockquote> <p><a href="http://sqlblog.com/blogs/jamie_thomson/archive/2012/03/27/adventureworks2012-now-available-to-all-on-sql-azure.aspx">SSIS Junkie : AdventureWorks2012 now available for all on SQL Azure</a></p> <p>Awaiting the launch of Tailspin toys to the cloud….</p> Andrewhttp://www.blogger.com/profile/01723071506840447394noreply@blogger.com0tag:blogger.com,1999:blog-5224419101759356031.post-28421342331904631232012-04-02T11:20:00.001-07:002012-04-02T11:20:29.577-07:00The R programming language for programmers coming from other programming languages<p>Learning R? An introduction and comparison against other common programming languages.</p> <blockquote><em>R is more than a programming language. It is an interactive environment for doing statistics. I find it more helpful to think of R as having a programming language than being a programming language. The R language is the scripting language for the R environment, just as VBA is the scripting language for Microsoft Excel. Some of the more unusual features of the R language begin to make sense when viewed from this perspective.</em></blockquote> <p><a href="http://www.johndcook.com/R_language_for_programmers.html">The R programming language for programmers coming from other programming languages</a></p> Andrewhttp://www.blogger.com/profile/01723071506840447394noreply@blogger.com0tag:blogger.com,1999:blog-5224419101759356031.post-70956565006279743692012-03-30T10:25:00.001-07:002012-03-30T10:25:52.783-07:00The Omega Project for Statistical Computing<p>Looking for R packages and addons? Here’s a bunch.</p> <blockquote> <h3><a name="toc1">The Omega Project for Statistical Computing</a></h3></blockquote> <p><a href="http://www.omegahat.org/">The Omega Project for Statistical Computing</a></p> Andrewhttp://www.blogger.com/profile/01723071506840447394noreply@blogger.com0tag:blogger.com,1999:blog-5224419101759356031.post-36786548394391910412012-03-22T11:22:00.001-07:002012-03-22T11:22:18.223-07:00Stack Exchange Data Explorer and Big Data<p>There are a lot of properties under the StackExchange banner. Here is a tool that lets you run SQL-style queries against them all.</p> <p><a href="http://data.stackexchange.com/">Stack Exchange Data Explorer</a></p> Andrewhttp://www.blogger.com/profile/01723071506840447394noreply@blogger.com0tag:blogger.com,1999:blog-5224419101759356031.post-72015557136625787142012-03-16T11:05:00.000-07:002012-03-16T11:05:00.536-07:00Installing hadoop development cluster on Windows and Eclipse -- Introduction<p>Hadoop & HDFS on Windows here for all the non-Linux types. Of course, this is missing all the Hive/Pig/etc goodness and the Cloudera configuration.</p> <blockquote><em>This tutorial describes how to set up such a cluster on a computer running Microsoft Windows. It also describes how to integrate this cluster with </em><a href="http://www.eclipse.org/"><em>Eclipse</em></a><em>, a prime </em><a href="http://java.sun.com/"><em>Java</em></a><em> development environment.</em></blockquote> <p><a href="http://v-lad.org/Tutorials/Hadoop/00%20-%20Intro.html">Installing hadoop development cluster on Windows and Eclipse -- Introduction</a></p> Andrewhttp://www.blogger.com/profile/01723071506840447394noreply@blogger.com0tag:blogger.com,1999:blog-5224419101759356031.post-68522663924845965522012-03-14T11:49:00.001-07:002012-03-14T11:49:13.540-07:00Java interop with .NET<p>To wire up those cloud apps that are written using Java, use some translation tools.</p> <blockquote> <p><em>IKVM.NET is useful for several different software development scenarios. Here is a sampling of some of the possibilities.</em> <ul> <li><a href="http://www.ikvm.net/uses.html#Drop-in+JVM"><em>Drop-in JVM</em></a> <li><a href="http://www.ikvm.net/uses.html#Use+Java+libraries+in+your+.NET+applications"><em>Use Java libraries in your .NET applications</em></a> <li><a href="http://www.ikvm.net/uses.html#Develop+.NET+applications+in+Java"><em>Develop .NET applications in Java</em></a></li></ul></blockquote> <p><a href="http://www.ikvm.net/uses.html">Uses for IKVM.NET</a></p> Andrewhttp://www.blogger.com/profile/01723071506840447394noreply@blogger.com0tag:blogger.com,1999:blog-5224419101759356031.post-18301114881048326152012-03-12T11:14:00.001-07:002012-03-12T11:14:14.991-07:00How-to install R on CentOS « /home/kOoLiNuS<p>Once you get your Hadoop cluster setup, you’ll probably want R. Here’s how to install it.</p> <blockquote><em>A not so christmas-connected topid today as I’m going to write down a few lines on how-to install the open source statistical tool and relative developement libraries </em><a href="http://www.r-project.org/"><strong><em>R</em></strong></a><em> on CentOS release 4 and 5.</em></blockquote> <p><a href="http://koolinus.wordpress.com/2008/12/23/how-to-install-r-on-centos/">How-to install R on CentOS « /home/kOoLiNuS</a></p> Andrewhttp://www.blogger.com/profile/01723071506840447394noreply@blogger.com0tag:blogger.com,1999:blog-5224419101759356031.post-12289409334930506742012-03-12T11:12:00.001-07:002012-03-12T11:12:43.255-07:00CentOS 5 - Networking Support - Setting up a folder share using Likewise over an Active Directory Network<p>You may want to access your CentOS VM using a file share at one point. Here’s how.</p> <blockquote> <p><em>I'm making a shift from Ubuntu to CentOS 5. Things are obviously quite a bit different between the two, as I've discovered. I'd appreciate some input as I make the shift.<br>The first problem (and hopefully easiest) is designating a folder to be shared. In Ubuntu it was as easy as right-clicking a folder and click Share Folder. I need to learn what the method is for CentOS, either via the GUI or otherwise.</em></p></blockquote> <p><a href="http://www.centos.org/modules/newbb/viewtopic.php?topic_id=15804">www.centos.org - Forums - CentOS 5 - Networking Support - Setting up a folder share using Likewise over an Active Directory Network</a></p> Andrewhttp://www.blogger.com/profile/01723071506840447394noreply@blogger.com0tag:blogger.com,1999:blog-5224419101759356031.post-73016069886722288152012-03-12T11:02:00.001-07:002012-03-12T11:02:08.933-07:00Cloudera–VM Setup to spin up some Cloud Computing Power<p>Cloudera provides a demo VM for download, to try out Hadoop, Hive, and those other friendly Zoo animals.</p> <p><a title="https://ccp.cloudera.com/display/SUPPORT/Cloudera's+Hadoop+Demo+VM#Cloudera%27sHadoopDemoVM-RunningtheVM" href="https://ccp.cloudera.com/display/SUPPORT/Cloudera's+Hadoop+Demo+VM#Cloudera%27sHadoopDemoVM-RunningtheVM">https://ccp.cloudera.com/display/SUPPORT/Cloudera's+Hadoop+Demo+VM#Cloudera%27sHadoopDemoVM-RunningtheVM</a></p> <p>If you’re trying to get the VM setup on Windows in Oracle VirtualBox</p> <blockquote> <p>With the VM powered off, click on ... the VM Name->Details-tab>General-> Advanced tab .. and select the checkbox "Enable IO APIC".<br>Power on the VM.. and that should at least get you and running.</p></blockquote> <p><a href="http://www.centos.org/modules/newbb/viewtopic.php?viewmode=thread&topic_id=19274&forum=45">www.centos.org - Forums - CentOS 5 - Miscellaneous Questions - Installing CentOS 5 in VirtualBox</a></p> <p>Setup Virtualbox to run in Bridged Network mode</p> <p>Fix permissions to run Hadoop jobs:</p> <p>cd /var/lib/hadoop-0.20/cache/cloudera/<br>chmod 777 .</p> <p>Hop right into Beehive with Cloudera/Cloudera userid/pw and try out the samples.</p> <p><a href="http://localhost:50070">http://localhost:50070</a> </p> <p>Try out Hue</p> <p><a href="http://localhost:8088">http://localhost:8088</a></p> <p>Setting up the stuff, end-to-end</p> <p><a title="http://gbif.blogspot.com/2011/01/setting-up-hadoop-cluster-part-1-manual.html" href="http://gbif.blogspot.com/2011/01/setting-up-hadoop-cluster-part-1-manual.html">http://gbif.blogspot.com/2011/01/setting-up-hadoop-cluster-part-1-manual.html</a></p> <p>Changing the terminal window colors in VI (because blue directories hurt my eyes)</p> <p><a title="http://www.cs.colostate.edu/helpdocs/vi.html" href="http://www.cs.colostate.edu/helpdocs/vi.html">http://www.cs.colostate.edu/helpdocs/vi.html</a><br><a title="http://ricochen.wordpress.com/2011/05/29/change-centos-ssh-shell-color/" href="http://ricochen.wordpress.com/2011/05/29/change-centos-ssh-shell-color/">http://ricochen.wordpress.com/2011/05/29/change-centos-ssh-shell-color/</a></p> <p>See the IP address of the machine<br><a title="http://www.cyberciti.biz/faq/how-to-find-out-the-ip-address-assigned-to-eth0-and-display-ip-only/" href="http://www.cyberciti.biz/faq/how-to-find-out-the-ip-address-assigned-to-eth0-and-display-ip-only/">http://www.cyberciti.biz/faq/how-to-find-out-the-ip-address-assigned-to-eth0-and-display-ip-only/</a></p> Andrewhttp://www.blogger.com/profile/01723071506840447394noreply@blogger.com0tag:blogger.com,1999:blog-5224419101759356031.post-46137298030121746092012-03-05T13:26:00.000-08:002012-03-05T13:26:12.956-08:00RenderMan in the cloud<div>I remember working on some rendered video back in the 90s. A single 30 second scene could take days to render at 25fps. This should bring the time down quite a lot.</div><div><br /></div><i><a href="http://renderman.pixar.com/products/news/release-renderman-on-demand.html">Pixar's RenderMan® / Press Releases</a>: "New cloud rendering service available in collaboration with GreenButton®<br /><br />EMERYVILLE, CA – (January 19th, 2012) Pixar Animation Studios today launched a new cloud rendering service called "RenderMan® On Demand™." Developed in collaboration with pioneering cloud services provider GreenButton, this service is now available on Microsoft's Windows® Azure with Linux availability following later in 2012. "RenderMan On Demand" offers nearly instantaneous burst rendering access to hundreds and even thousands of additional cores, enabling artists and studios to deliver the highest-quality cinematic imagery with unprecedented economy and efficiency."</i><br /><br /><a style="font-style: normal; font-size: 13px; " href="https://chrome.google.com/webstore/detail/pengoopmcjnbflcjbmoeodbmoflcgjlk">'via Blog this'</a>Andrewhttp://www.blogger.com/profile/01723071506840447394noreply@blogger.com0tag:blogger.com,1999:blog-5224419101759356031.post-89087845246518106832012-02-22T08:48:00.001-08:002012-02-22T08:48:17.776-08:00From Concept to Code in 6 hours: Shipping my first Windows Phone App - Scott Hanselman<p>Did I say Cloud? I meant Cloud + Windows Phone 7. A great article step-by-step on how to build a WP7 app.</p> <blockquote>I made my first Phone Application. I've spent about 6 hours on it. It's called Lost Phone Screen and it makes nice wallpaper. It's over at <a href="http://lostphonescreen.com">http://lostphonescreen.com</a>. It's a <a href="http://www.lostphonescreen.com/">simple customizable Windows Phone 7 Lockscreen</a>. It was way easier and more fun to make than I expected. If I make a million bucks with this thing I'm GONE. You'll never see me again. :)</blockquote> <p><a href="http://www.hanselman.com/blog/FromConceptToCodeIn6HoursShippingMyFirstWindowsPhoneApp.aspx">From Concept to Code in 6 hours: Shipping my first Windows Phone App - Scott Hanselman</a></p> Andrewhttp://www.blogger.com/profile/01723071506840447394noreply@blogger.com0tag:blogger.com,1999:blog-5224419101759356031.post-32554794054770348212012-02-15T07:07:00.001-08:002012-02-15T07:07:47.931-08:00How to find all Azure sitesThis blog will capture my thoughts and links on cloud technology.<br />
<br />
First link: Search Google or Bing for site:cloudapp.net to get all the sites using Microsoft Windows Azure.Andrewhttp://www.blogger.com/profile/01723071506840447394noreply@blogger.com0