Generating Heatmap using FME

In this topic I describe how can use the Software FME to connect in the API from Strava and generate a Heatmap.

Last week I posted on twitter a short video demonstrating the heatmap generation using FME:

 The figure bellow shows this process:

Scenario:

 After a hard day of work, nothing better than running out.

 To monitor my Run i use the app from Strava. This app monitors the route by storing the informations: latitude and longitude, time, date, elevation, distance in KM, average speed, etc.

Once i finish my activity, the app salved my informations and this activity has a ID.

And now, how can i read the information my activity???

Do not P-A-N-I-C!

The Strava has a rich and documented API that enables us to access your activity.

To request your data using the API you need a access_token , that is possible to be obtained in Strava API Reference

- https://strava.github.io/api/#access



The next Step it's in Software FME Desktop.

We build a Workspace to prepare to read the data originated by Strava and generate a Heatmap in python language.


Main points in Workspace:

1. Use the transformer Creator to start your Workspace
2. The  transformer HttpCaller is responsible to makes request to API Strava, using a URL and return in JSON all information your activitie respecting the id_activity amd access_token : https://www.strava.com/api/v3/activities/id_activity/streams/time,latlng,distance,altitude?access_token=xxxxxxxxxxxxxxxxxx.

Example JSON:

      3. Extract the informations lat and long from JSON and configure the transformer PytonCaller to receive these informations and generate the Heatmap.

      First we need to install a free library Heatmap into folder to site - packages in FME:

                                       fmepython27\lib\site-packages

     Installing the library heatmap using your IDE. I used the Pycharm to test this:

                                                        pip install heatmap

  Another action important to do is import a library responsible to work with different image file formats, the library PIL in the same folder to site - packages in FME.

                                                       pip install Pillow

    4. PythonCaller = Where the Magic happens

        

         Generating Heatmap:

     This sript in Python generate a KML with Heatmap and you can extract from this KML the Heatmap created

Conclusion: You can explore all possibilites with python using the transformers PytonCaller and PythonCreator.

See you on the next Post :)

FME Objects API for Raster using Python

Hi all FME User's,

In this Year the FME Desktop bringt the new API for Raster using Python. Its possible to make any actions, for example: create a mosaic, make Clipper, extract informations Bounding Box from Raster file, remove Band, etc...

Inside FME Core has transformer to do theses actions, but if you are a Pythonics like me :) you can create scripts language in Python.

I created a Workspace that demonstrate a just Clipper using only Python Script.

The source data is a Raster file and the transformer AttributeCreator  is configurated  parameter the Bounding Box informations : XMin,yMin,XMax and yMax.

Continuing we have the transformer PythonCaller. A PythonCode was written to receive the information Bounding Box and make a just simple Clipper action.

The class responsible to performs a clipper on raster file is FMERasterTools.

Has a important documentation online to understand better the use API for Raster File:

https://docs.safe.com/fme/html/FME_Objects_Python_API/index.html

I entered below the Python Code with comments:

How you can see above, on the line 17 I check the geometry source data if is a Raster file ( if tipo == 512 ). If the transformer PythonCaller receive another geometry instead Raster file, the information will be show in Attribute tipo ( line 28 ).

And the line 23 the action Clipper was configurated with simple line code:

Now, everybody can program use the API for Raster using Python. Access the documentation and play with Python and transformers. :)

If anyone has any doubt, please contact me that i will help.

See you the next Post.

GeoPython2017 = Great Event

Hi everybody,

In this Post  i  describe my experience in the GeoPython2017.

Realized last week in days 08 , 09 and 10 the Conference about Python for Geo - Community in the city of Muttenz.

The University of Applied Sciences and Arts Northwestern Switzerland received this event.

The organization of this Conference impressed me very positively, like:

• Easy access to University
• The quality of facilities - Room, Auditorio and sound
• Delicious Coffee Break 😋😋😋
• A lot of Coffee
• Time of Talks - time of start and finish was respected
• Good atmosphere

During the event had great Workshops, Talks and Lightning Talks.

Topics involving Python in GIS have been presented brilliantly:

• 3D Point clouds
• QGIS and Python
• Web Services
• Big Data
• Data Processing
• Robotics
• and more ...

The Schedule can be viewed on the official website https://2017.geopython.net/schedule.pdf

A very interessante factor during the Coffee Break and all time was the  good integration between all participants.  We changed our experiences and cases with each other ( culturally it was great ) :)

There were people from several places around the World. To be more accurate: 120 attendees from 25 Nations!!!




My presentation about: Using Python and FME ETL was intensive and positive, a great experience of my life.

About the Slides of my presentation, I'll share it on the next Week.


If someone will have any doubt or questions about my talk,  Please don't hesitate to contact me here on my Blog .

 The Photos below shows my moment during my Talk:

All paying attention

It's TIME



Now begins the preparation the new examples and Demos to share on the next GeoPython2018 . :)

See you on the next Post!






GeoPython 2017

Hi everybody,


In 4 days it will start a Conference about Python in Geo.

I'm particularly very excited to participate in this event in the city of Basel - Switzerland :).

The Schedule has interesting Talks and I'll give a Talk about :Using Python and FME ETL.

That is a great opportunity to meet others pythonics and change ideas and experience .

During the next week I'll update my Blog with the news about the Conference and share the slides of my presentation.

More informations https://2017.geopython.net


See you in Switzerland!!!

Introduction to the Blog

Hello everyone! :)


I'm very excited with the creation of this Blog.



For a special reason: to share with all my experiences of the subjects that i like and work, for example:

• GIS
• ETL
• Maps
• Validation
• Intergration
• IoT
• Python
• Cloud Comunication and more...

So, Who am I? ??

My name is Danilo de Lima, I'm a Spatial ETL Analyst and work with software ETL - FME ( provided by SAFE Software www.safe.com ).

Through the use of the software FME, I got a experience using a datatypes like: Raster, Lidar, XML, Json, vector data, Notifications Service, Python Language, and so...

Certifications: FME Professional and Trainer.


And now? - I want to publish  subject every two weeks, so Stay Tuned!