- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Flow
Automation

Automation

Schedules, triggers, events, alerts, and notifications.

802 Posts
2,719 Replies

When you subscribe we will email you when there is a new topic in this category

802 Posts

Most replies

Recently active Most views Newest first

helmoet

asked in Automation

FME Server Single Sign-On refuses logins while Active Directory login works fine

Hi, It must be stunningly simple however we miss the clue, but we're trying to get FME Server to accept Single Sign-On logins. We connected to Active Directory, that seems to work nice since we can use a user and password from the domain and log in, that's a success. Mon-13-Nov-2017 04:20:33.924 PM INFORM RequestHandler-Thread 401831 : Accepted new client connection from /127.0.0.1 on port 7,071Mon-13-Nov-2017 04:20:33.926 PM INFORM RequestHandler-Thread 401933 : Successful login by user XX99999However, when we press the Use Windows Credentials the login is denied and fmeserver.log shows this error message:Mon-13-Nov-2017 04:23:22.734 PM INFORM RequestHandler-Thread 401831 : Accepted new client connection from /127.0.0.1 on port 7,071Mon-13-Nov-2017 04:23:22.770 PM INFORM RequestHandler-Thread 408043 : (Single Sign-On) Enabled single sign-on authentication.Mon-13-Nov-2017 04:23:22.770 PM INFORM RequestHandler-Thread 408049 : (Single Sign-On) Using pre-authenticated cre

29226

5 years ago

pvmvirusParticipant

asked in Automation

How do i dissolve line segments into longer lines

Hi, I am trying to connect transmission lines to POIs using the PointonLineOverlayer but before that i wanted to dissolve all the transmission lines into a singular line/polyline. The issue I am having is that regardless of what I try I am getting breaks in the lines where there isn’t supposed to be any like in the image below. I am trying to use a combination of the generalizer, snapper, intersector, and linecombiner transformers but these breaks still persist. I even tried to buffer the lines, dissolve and then use centerline replacer and they persisted. Would appreciate any advice on this manner.

data download service no data download url?

austinDownload.fmw sample is producing a data download url, a zip in the engineresults directory and writing featuresmine is writing features (no log error) but no url or zip in the engineresults directoryI'm a newb with FME Desktop and Server and don't know where to start.

Library 'D:\\Program Files\\FMEServer\\Server\\fme\\plugins/CSV2.dll' was found but could not be loaded. Ensure that all the dependent modules exist for this library

I'm having some issues with our FME Server which I don't understand. Every now and then, when running a nightly scheduled job, a FeatureReader fails to read a CSV file. The log returns:Trying to find a DYNAMIC plugin for reader named `CSV2'Library 'D:\Program Files\FMEServer\Server\fme\plugins/CSV2.dll' was found but could not be loaded. Ensure that all the dependent modules exist for this libraryModule 'CSV2' is unavailable for use with this FME editionWhen I resubmit the job, everything works fine... which is great for the data being processed, but harder to debug. The issue feels somewhat familiar and I did find similar questions but not related to CSV2.dll.I'm quite sure this is not related to desktop/server versions. Version is 2019.1.2.As far as I am aware nothing has changed in the installation, I do know the certificates were replaced recently but I doubt this has anything to do with it. Not sure where I should start looking, can anyone point me in the right direction? Update:

Notification Service - Send Notification Data to Reader - Distributed engines

Basically we have some fmw files that write data, and then we have a second fmw file that loads the job status info into an oracle table for logging. The first fmw, runs and then calls the DataLoadingStatus topic Then the called mw, which populates an Oracle table with job status info from the first fmw runs, it is registered with the notification service with the “Send Notification Data to Reader” populated We are running with engines distributed across a number of different boxes. The process is working correctly for what it is, it is passing the correct path to the second fmw to find the temp file. e:\\FMEServer\\Utilities\\tomcat\\temp\\603774853810044_gpas_status.txt - That file does exist on the core host. The problem is the Engines are distributed, so when the second fmw runs on a distributed engine and goes to read that file, it is looking for that path on the local box’s E drive and not the Core host box, and that file does not exist on the local box, so it errors

Hi,Each time I try to use the Emailer transformer in a workbench, I get this error message :2018-02-12 15:28:28| 0.5| 0.1|WARN |Python Exception <UnicodeDecodeError>: 'ascii' codec can't decode byte 0xe9 in position 43: ordinal not in range(128)2018-02-12 15:28:28| 0.5| 0.0|WARN |Traceback (most recent call last): File "Emailer.py", line 126, in inputUnicodeDecodeError: 'ascii' codec can't decode byte 0xe9 in position 43: ordinal not in range(128)2018-02-12 15:28:28| 0.5| 0.0|ERROR |Error encountered while calling method `input'2018-02-12 15:28:28| 0.5| 0.0|FATAL |f_6(PythonFactory): PythonFactory failed to process feature2018-02-12 15:28:28| 0.5| 0.0|ERROR |A fatal error has occurred. Check the logfile above for details I tried with the generic SMTP and a Gmail account and always get the same error.Any ideas ?Thanks

7216

6 years ago

mattenpContributor

asked in Automation

Topic Monitoring not working FME Server 2017

Hi,if I click on "Topic monitoring" in the fme server portal I get the error:"There was an error connecting to monitoring service"The port 7078 is open and if I request http://fmedev-test.de:7078/, I get the answer "not a WebSocket handshake request: missing upgrade". So the firewall rules should be right and a telnet command to fme server via 7078 also works.I've also set WEB_SOCKET_SERVER_NAME inUtilities\\tomcat\\webapps\\fmeserver\\WEB-INF\\conf\\propertiesFile.propertiesThe logs from websocket.log in publishers and subscribers are:Opening log file using character encoding UTF8 Tue-13-Feb-2018 02:45:58.721 PM INFORM main 801001 : Publisher "websocket" is starting up ... Tue-13-Feb-2018 02:45:58.721 PM INFORM main 801002 : Publisher "websocket" is updating configurations ...Opening log file using character encoding UTF8 Tue-13-Feb-2018 02:45:52.909 PM INFORM main 803001 : Subscriber "websocket" is starting up .

Add subject to the email received from a job

Dear All , We are using rest services of FME to post jobs , we need to pass a custom message which need to be shown on the subject of the email receive by the user when the job is done , users submit many jobs but not able to relate the job to the task .

FMEServerJobSubmitter problems

Hello,we are using FmeServerJobSubmitter. Fme version 2019. There is a strange problem: job is submitted, I can see it on the jobs list. So on the jobs list there are 2 jobs: main one and submitted. In the logs of main there is information: 2019-07-28 22:56:41| 1.0| 0.0|INFORM FMEServerJobSubmitter (ServerFactory): http://fmetest.com:80 - Running workspace2019-07-28 23:01:41| 1.1| 0.1|WARN FMEServerJobSubmitter (ServerFactory): http://fmetest.com:80 - Failed to submit request to run workspace2019-07-28 23:01:41| 1.1| 0.0|ERROR |FMEServerJobSubmitter (ServerFactory): Reason - ''So it looks that after 5 min main workspace decided that it could not submit request, it logged what is above and finished. But child job was actually still running for 15 min more (as expected as this job takes 20 min) and then it finished. I use settings in fme server job submitter:SubmitJobs: In sequenceWait for jobs to complete: Yes Funny thing is that if child workspace finishes before 5 min then e

Why FmeServer run workspace results cannot download,suggests the requested dataset has expired,please request it again to generate a new dataset avaliable for download,The following figure

How to loop an HTML Caller

Hey everyone, I have an API that hold historical data. I would need to retrieve all the data for the past year. I am using a HTTP Caller to retrieve data. The API only allows for 30 days for one location to be retrieved at once.I have 36 locations, and about 15 months worth of data to retrieve. I already have workbench that retrieve one month for one location worth of data.How can I create a loop that would go through all these locations and date list automatically?

20815

1 year ago

coryContributor

asked in Automation

How do I configure OAUTH for Exchange Online?

Hi team,with the deprecation of Basic Authentication coming up in October later this year (Deprecation of Basic authentication in Exchange Online | Microsoft Docs),it's been suggested we move across to OAUTH for accessing emails via FME Server Automations. I'm a little stuck on how we can do this? There doesn't seem to be any OAUTHcapability within the templates? Any suggestions on how we can achieve this?

16315

1 year ago

elponeContributor

asked in Automation

Can SQLExecutor be used to get around having to read in all the data from a database table into FME and then running a feature joiner.

Can SQLExecutor be used to get around having to read in all the data from a database table into FME and then running a feature joiner?Consider the example below we need to read in the entire table of 2Million plus records to extract data we are interested in.What I think should be possible but I'm not sure how to implement it is to create a temp table and use that as a subselect or joined table to get the data using a SQL query

17514

3 years ago

adrian_farrellContributor

asked in Automation

Hi I have a workspace that runs from Workbench but if i try to run from a Scheduled task i get no output I have put snips of the ERROR and FATAL messages below. This has happened in 2020.1.1.0 (20200801 - Build 20608 - WIN64) and 2020.1.0.0 Th

4514

3 years ago

xtian79Contributor

asked in Automation

React against a cancellation of a workbench job?

I have a long running workbench on the FME server. Is it possible to take actions if a job submitted is canceled?proposed workflow1. submit a job2. cancel a job3. write into a file information regarding the job that was cancelled (is possible to do it inside the same workbech? is possible to do it with another workbench? a subscription could help??) [EDIT]:The idea is that step 3 is automatically triggered after the cancellation of the job, that is what I mean by "React".[EDIT]: I am using FME Server 2018.1.2 - Build 18590 - win64: I notice that JOBSUBMITTER_ASYNC_JOB_FAILURE topic is not triggered when a job is canceled.thanks for any hint provided.

Download URLfrom server app

So, I've created an server app that sometimes posts very large datasets and have so far been able to restrict access to the data by just emailing the dataset back as an attachment (user email as parameter)(its not super safe, but safe enough - the data isn't super sensitive but sensitive enough). I've thus been able to restrict the data to the person running the server app by letting the person enter their email and get the data back that way. But now the datasets is growing kinda fast and the email client isn't putting up with 20-50 megabytes of attachments. So I read that it was possible to get the server app to respond with the download link (again not super safe, but safe enough). So: how do I do that? What parameter carries the data download link from server apps? Or, it doesn't work that way? (in wich case I'd have to do a workaround, and nobody likes workarounds :-) Been searching and trying for several hours without luck. Tried the ServerNotifier and the

35313

4 years ago

fmesafe.podporaContributor

asked in Automation

Inserting values into the script

Hey. Hey. I need some way to automate adding a time interval to a script in pythoncaller see attachment. I have a regular WS which I don't publish directly to the server, however it is not a problem to publish to the server, I have it available as well. It depends on whether the automation will be handled within some workspace or by some setting on the server, I don't know what your advice implies.So I have a calendar created in postgress DB see attachment, where I have airac_start and airac_end values - this is the time interval. I need to add these values to a script in pythoncaller ( there are two in WS ). This addition would happen by pasting the source files somewhere on disk ( probably watching for a change in the contents of the folder would be like a trigger ), which would start the whole process and depending on what cycle should be running, the airac_start and airac_end values would be added to the script. Can anyone think of any way to automate this thing? The way I work now

7213

8 months ago

curtisd54Contributor

asked in Automation

Hello I am looking to implement these rules within my data: eliminating: 1) polygons less than 1m2 2) polygons less than 1m in width 3)duplicate vertices less than 1m apart any help is appreciated. thanks, Curtis

I have tried an area calculator and area selector for polygons less than 1m2which appears to work but I wonder if there is a better method

How do you setup Directory Watch for folders on your local shared server.

I'm trying to figure out how to use the directory watch on various user folders. The idea is when they update datasets it kicks off a job updating automatically.

Problem with notification that is not "activated"

Hi all,I encounter an issue with topic on FME Server:I have one workspace (the controller) that triggers another (the worker) via a jobsubmitter.The worker posts on the topic "reporter_database" in case of success. It sends some json code.Case 1: When I run the worker via the controller, the topic is not "activated".Case 2: If I launch the worker directly via the web browser interface, it runs correctly and activates the topic.I remarked there was a difference between the two approaches (see picture). On the rigth (case2), there are some FME Directives and Notification Manager Directives while there is nothing on case1...Does someone have an idea how I can solve the case 1?Thank you !Laurent

2513

6 years ago

lifalin2016Contributor

asked in Automation

Automation actions being involuntarily "cleaned" ?

Hi.I have some automations running on 2022.2.2, and had to do a small edit on one of them. Afterwards the automation failed badly.I found that all the workspace actions in the automation had been "cleaned", i.e. set back to their default (workspace) setting of parameters. All of them. And I hadn't edited any of them, just moved some connections.No wonder the automation failed badly, as I'm e.g. using automation writer features to pass information between the actions. And have some global settings too for good measure.Has anyone experienced something similar ?What might have caused this ?Cheers.

2412

1 year ago

pushpaContributor

asked in Automation

Set NEW Output file name every time User runs the batch file.

I would like to User to rename the output FGDB name every time they run the FME script using the batch file.I have a FME 2022.2.4 workbench file that output Data on to a FGDB.FGDB has many feature classes, line points and polygon.I have created User Parameter called "NAMEFGDB" then linked with the "Writer". When I run the script using workbench or quick translator it prompt and I can change the FGDB name.However when I run using the batch file, even though I can type the new name for the FGDB, it still writes out to Default database name. My Batch file is as below.@echo ## Start translation ## set /p NAMEFGDB=type fgdb name:"C:\\Program Files\\FME\\FME2022-1-2\\fme.exe" D:\\GIS\\Data_extract_by_Area.fmw@echo ## End translation ##pause Is there anything else I need doing to connect the FME script to batch file?

Using Directory Watch in FME Server, not triggering workspace with each new file.

I have a workspace that watches a specific folder for csv files to be added to it.The workspace then converts the csv file to a shapefile.If i copy just one csv file into the folder it works perfectly.If i copy more than one csv file then server kicks off an instance of the workspace for each csv file added but it reads in the first csv file in the folder to every instance ignoring the rest of the csv files in the folder.Also if the folder already has a csv file in the folder and a second is added, server will kick of the workspace and run it using the csv file that was originally in the folder and not the new one.any ideas what i may be doing wrong?@aaronkoning

How do I send a log file as an email attachment in FME Sever Automations?

Hi,I am using Automations in FME Server 2019.1 for the first time and I want to add the log file as an attachment to an email.I have tried inputting the following two options into the Emailer but neither worked.Option 1:$(FME_SHAREDRESOURCE_LOG)/engine/current/jobs/*/{job id}.log Option 2:{job.log} Automation Workflow:As a side note, I would also like to know if it is possible to send multiple attachments with the Emailer in Automations? If so, what would the syntax be for that?Thanks in advance!

29912

4 years ago

gisbradoklaEnthusiast

asked in Automation

delete empty FC in fgdb

I am writing file geodatabases using templates. this causes all fc in the template to be written wheter there are features in the workbench or not. If i am writing the gdb in an automation the only method i can think of is to have a second wb that opens the gdb that was just written and test for features in each fc. but then there is the problem of delteing the entire talbe. the database deleter will only delete rows. the database updater works on features also (not tables)Any Ideas how to accomplish this?I guess i will have to go with the read the schema method. this machine is used for fme server as well as desktop and as such i do not have a single use license for arcpro. so i have no way of using arcpy that i can find. as for the reading the schema solution. @ebygomm i guess just using a gdb reader and connecting each fc to it's output? but what about domains?

13012

2 years ago

Page 1 / 33

Badge winners

pbyhistorianhas earned the badge Student (Grey)
pbyhistorianhas earned the badge Teacher (Bronze)
pbyhistorianhas earned the badge Teacher (Grey)
kwanghohas earned the badge Welcome Back
pbyhistorianhas earned the badge Welcome Back

Show all badges

30,123: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.