Skip to content

Change Record

The current version of DataFlux Func is 6.x, and all previous versions have been archived. Only downloads are provided, with no further updates or support.

For the version correspondence relationship between "Self-deployed DataFlux Func" and "Guance-affiliated Func", please refer to:

3.7.2 (2024-04-28)

  • Optimize UI

3.7.1 (2024-04-28)

  • Fix known Bugs

3.7.0 (2024-04-28)

  • Replace official script market URL address
  • Add business Metrics information on Summary page
  • Fix text issues
  • Adjust UI

3.6.0 (2024-04-25)

  • Add "password" class to environment variables. When exporting a script set, password-type environment variable content will be exported as an empty string.
  • Increase SALT for all password saving processing
  • Use a separate field "non-critical errors" to save Guance data reporting errors
  • Fix known Bugs
  • Optimize code
  • Optimize UI

3.5.3 (2024-04-15)

  • Adjust one-click installation script text
  • Optimize deployment failure prompt in the script market

3.5.2 (2024-04-12)

  • Small UI adjustments

3.5.1 (2024-04-12)

  • Optimize service list on Overview interface

3.5.0 (2024-04-12)

  • Add service list display on Overview interface
  • TaskTimeout changed to inherit from BaseException, preventing it from being caught by user code which could prevent task interruption
  • Minor code adjustments

3.4.6 (2024-04-10)

  • Optimize git-based script market module
  • Add time zone abbreviation table for automatic conversion of unknown time zone abbreviations
  • Automatically select the listening IP as the access target when initializing script access to Func itself
  • Optimize UI, code, and text, delete useless files

3.4.5 (2024-04-07)

  • Fix DataFlux Func one-click download script BUG

3.4.4 (2024-04-07)

  • Optimize display of Python package lists installed by PIP tool

3.4.3 (2024-04-03)

  • Fix issues where recent execution times are displayed incorrectly in authorization links, auto-trigger configurations, and batch processing

3.4.2 (2024-04-01)

  • Fix issue where expiration times cannot be set in authorization links and auto-trigger configurations

3.4.1 (2024-03-31)

  • Update deployment scripts to enable automatic configuration and automatically skip manual interaction steps

3.4.0 (2024-03-29)

  • Upgrade one-click installation script bundled Docker to version 23.0.6
  • Update one-click download and installation scripts to support selecting Docker upgrade during installation

Older versions of DataFlux Func come with Docker version 20.10.8, which cannot start containers based on Ubuntu 22.04

3.3.3 (2024-03-29)

  • Base image upgraded from Ubuntu 20.04 to Ubuntu 22.04
  • Fix issue where DFF.RESP_LARGE_DATA becomes ineffective when cache_result is not specified
  • Fix issue where disabling automatic DB backup option does not work
  • Optimize log output in UI interface, allowing copying logs
  • Optimize format of Guance data reporting
  • Optimize code, update relevant documentation
  • Adjust Exception name for error reporting
  • Add capacity limit to DB automatic backup processing

3.3.2 (2024-03-19)

  • Fix BUG where DataKit cannot use .write_xxx_many(...) method for bulk writes
  • Fix issue where file service functionality can access content outside the allowed range via ..
  • Lock accounts for several minutes after multiple incorrect login attempts

3.3.1 (2024-03-18)

  • Optimize DFF.THREAD function

3.3.0 (2024-03-14)

  • Automatic trigger configuration supports custom Crontab syntax
  • Editor adds code folding tools
  • The .write(...) series methods of DataKit / DataWay connectors add support for headers parameter
  • Adjust task log output
  • Beat service supports running multiple simultaneously, ensuring only one takes effect
  • Optimize recent trigger time records
  • Guance data reporting adds error retry mechanism
  • Optimize DFF.THREAD function
  • Fix known BUGs, optimize UI

3.2.2 (2024-02-22)

  • Fix issue where calling DataWay.query(...) on Guance connector does not return data

3.2.1 (2024-02-22)

  • Fix issue where private deployment of Guance cannot be configured in installation interface
  • Adjust docker-stack.example.yaml file for standalone deployment

3.2.0 (2024-02-22)

  • Update Traditional Chinese support (based on OpenCC conversion)
  • Support temporary adjustment of Crontab execution frequency within scripts
  • Support restarting Server, Worker
  • Optimize beat, add lag compensation
  • Automatic trigger configuration adds recent task trigger records
  • Optimize function task record handling (can record recent run status even when local task records are turned off)
  • DataKit, DataWay support field arrays
  • Adjust default queue configuration
  • Adjust dependency package versions
  • Adjust _DFF_HTTP_REQUST return value
  • Optimize frontend code to avoid circular reference problems
  • Optimize mysql_helper
  • Automated script generation of OPENSOURCE.md
  • Passive restart changed to active restart
  • Add line numbers to each Trace/Task log output
  • Fix issue where trailing blank lines are lost when installing from the script market
  • DFF.CONFIG can retrieve all configurations (sensitive configurations are not displayed)
  • Expand length of originId field in task record table

Adjusted Default Queue Configuration

  1. System Tasks
  2. User Functions (General Purpose)
  3. User Functions (Auto Trigger)
  4. User Functions (Batch Processing)
  5. [Idle]
  6. Debug Run
  7. Message Subscription
  8. Guance Dedicated (General Purpose)
  9. Guance Dedicated (Auto Trigger Configuration)
  10. Guance Dedicated (Auto Trigger Configuration - Complex Tasks)

Temporary Adjustment of Auto Trigger Configuration Crontab

In some cases, script developers may need to dynamically control the function execution frequency within the script. This feature can be used for this purpose:

Python
1
2
3
4
5
6
# Set temporary frequency
DFF.CRONTAB_CONFIG.set_crontab('* * * * *')
# Set temporary frequency, automatically expires after 300 seconds
DFF.CRONTAB_CONFIG.set_crontab('* * * * *', expires=300)
# Clear temporary frequency
DFF.CRONTAB_CONFIG.clear_crontab()

3.1.0 (2024-01-11)

  • Add global pause for auto-trigger configuration
  • Refactor part of system Metrics collection processing (changed to Python tasks)
  • Ensure that tasks run multiple times using crontab_delay parameter do not run simultaneously
  • Task record page distinguishes between delay execution and queue waiting duration
  • Adjust order of auto-trigger configuration items
  • Adjust database connection pool size
  • Adjust database timezone parsing error messages
  • Adjust database timezone reading processing, compatible with Asia/Beijing
  • Delete redundant SQL content, unused code
  • Fix translation issues
  • Fix issue where operations on keys containing slashes cannot be performed in function cache manager
  • Other UI optimizations

3.0.18 (2023-12-14)

  • Add Guance data reporting failure prompts to task record page
  • Fix BUG where auto-trigger configuration cannot be modified
  • Log errors when Guance log reporting fails

3.0.17 (2023-12-13)

  • Optimize subscription processing and interface
  • Automatically clean expired data in DFF.STORE
  • Distinguish between CrontabDelay and Delay, where Delay is real delay: Specified Delay + CrontabDelay
  • Task distribution execution strategy changes from "distribute sequentially according to sequence number" to "fixed distribution according to seq"
  • UI, default parameter adjustments

3.0.16 (2023-11-21)

  • Fix known BUGs

3.0.15 (2023-11-21)

  • Fix known BUGs

3.0.14 (2023-11-21)

  • Docker Stack deployment image changed to fixed version (latest -> x.y.z)
  • Add DFF.EXTRA_FOR_GUANCE, used to add extra Tags and Fields when reporting self-monitoring data to Guance
  • Adjust Crontab.Starter log output
  • Adjust task timeout and task lock error messages
  • Fix issue where interface names in operation records are not correctly translated
  • Support both delayed execution of Crontab (delayed_crontab) and distributed execution (_FUNC_TASK_DISTRIBUTION_RANGE) simultaneously
  • Sort task records on the front-end page based on triggerTimeMs for better viewing experience
  • Manual Crontab execution ignores Crontab Delay options
  • Adjust Guance node-related UI and list retrieval method
  • Optimize function selector: do not show blueprint options when there are no blueprints
  • Ensure _DFF_CRONTAB_DELAY has a value (0 if not automatically triggered)
  • Fix known BUGs

3.0.13 (2023-11-07)

  • PIP tool supports installing using custom PIP Index URL
  • Fix issue where parameters are merged incorrectly during function calls
  • Other code optimizations

3.0.12 (2023-11-06)

  • Add protection to DFF.ENV etc., preventing original content from being modified
  • Add push / pop aliases for lpush / rpop to Redis connector objects

3.0.11 (2023-10-30)

  • Fix issue where new script creation does not correctly redirect to the new script
  • Optimize task record processing
  • Optimize subscriber, provide latest consumption and consumption result views
  • Default configuration splits worker-1-6 into worker-1-5 and worker-6
  • Script saving automatically removes trailing spaces, converts Tab to 4 spaces, and trims trailing blank lines
  • Optimize UI, Swagger configuration on OpenAPI documentation page
  • Optimize internal processing

3.0.10 (2023-10-17)

  • Optimize underlying code

3.0.9 (2023-10-13)

  • --upgrade option for PIP tool is selected by default
  • PIP tool supports installing packages in the form of pkg1 pkg2,pkg3, where space-separated packages are installed using separate pip install commands; comma-separated packages are installed in the same pip install command.

Example: Azure SDK for Microsoft Cloud needs to be installed using azure-idengity,azure-mgmt-core to avoid issues where one package overwrites another.

3.0.8 (2023-10-13)

  • Adjust details of PIP tool processing

3.0.7 (2023-10-13)

  • Optimize editor input hints
  • Optimize timezone processing
  • Move locking processing of automatic trigger configuration from Crontab.Starter (starter) to Func.Runner, reducing starter pressure
  • Add LRU caching for some parts involving Crontab processing, improving performance
  • After enabling monitoring data reporting to Guance, system tasks also report logs
  • Add --upgrade option support to PIP tool
  • Adjust some default configurations
  • Optimize code

3.0.6 (2023-10-09)

  • Update third-party package DBUtils
  • Adjust DB connection pool related code, switch to using PooledDB
  • Optimize import modules, automatically remove non-existent fields from data to be imported
  • Optimize startup timezone judgment; fix issue where script library cannot recover properly

3.0.5 (2023-09-22)

  • Fix issue where scripts exported from 2.x cannot be imported into the latest version
  • Adjust task execution module log output
  • Adjust function delay processing
  • Adjust default configurations
  • UI optimization

3.0.4 (2023-09-21)

  • Optimize underlying code

3.0.3 (2023-09-21)

  • Optimize built-in nodes in blueprints / DingTalk robot nodes
  • Optimize built-in nodes in blueprints / HTTP request nodes
  • Optimize UI

3.0.2 (2023-09-20)

  • Optimize UI

3.0.1 (2023-09-20)

  • Fix issue where _DFF_HTTP_REQUEST content is missing in script context
  • Fix issue where timezone handling is abnormal when MySQL timezone is +8:00 or other non-standard formats
  • Optimize Redis calls within scripts, hdel command supports deleting multiple fields at once
  • Optimize integration function task record processing
  • Optimize timezone judgment processing
  • Update Guance test environment address
  • Optimize UI

3.0.0 (2023-09-15)

DataFlux Func 3.0 officially released

  • Entirely new Blueprint module based on LogicFlow
  • Authorization links, auto-trigger configurations, and batch processing support choosing to execute traditional functions or blueprints
  • Create and configure operations changed to pop-up style, reducing unnecessary page jumps
  • Adjust Overview page, improve response speed, optimize queue status display
  • Task record counts in authorization link, auto-trigger configuration, and batch processing list pages are obtained asynchronously, improving page response speed
  • Optimize local task record saving and Guance data reporting processing. Allow closing local task records to reduce database pressure
  • Optimize Guance node list retrieval method
  • Optimize compression and decompression processing in the file management module
  • Fix issue where Socket.io does not work properly in some cases
  • Remove Celery framework, replaced with self-developed task scheduling module
  • Fix accumulated UI issues and BUGs