| (The variable values in the following table take 20240229 in leap year as a special date as an example)</p><table><thead><tr><th>variable name</th><th>variable type</th><th>variable meaning</th><th>variable value example</th></tr></thead><tbody><tr><td>run<!-- -->_<!-- -->date</td><td>String</td><td>Data statistics time (users can set it themselves, the default setting is the day before the current time), if you execute yesterday’s data today, it will be yesterday’s time, the format is yyyyMMdd</td><td>20240229</td></tr><tr><td>run<!-- -->_<!-- -->date<!-- -->_<!-- -->std</td><td>String</td><td>Data statistics time (standard date format), if yesterday’s data is executed today, it is yesterday’s time, the format is yyyy-MM-dd</td><td>2024-02-29</td></tr><tr><td>run_today</td><td>String</td><td>The day after run_date (data statistics time), the format is yyyyMMdd</td><td>20240301</td></tr><tr><td>run_today_std</td><td>String</td><td>The day after run_date (data statistics time) (standard format), the format is yyyy-MM-dd</td><td>2024-03-01</td></tr><tr><td>run_mon</td><td>String</td><td>The month of run_date, the format is yyyyMM</td><td>202402</td></tr><tr><td>run_mon_std</td><td>String</td><td>The month of run_date (standard format), the format is yyyy-MM</td><td>2024-02</td></tr><tr><td>run<!-- -->_<!-- -->month<!-- -->_<!-- -->begin</td><td>String</td><td>The first day of the month where the data statistics time is located, the format is yyyyMMdd</td><td>20240201</td></tr><tr><td>run<!-- -->_<!-- -->month<!-- -->_<!-- -->begin<!-- -->_<!-- -->std</td><td>String</td><td>The first day of the month where run_date is located (standard date format), the format is yyyy-MM-dd</td><td>2024-02-01</td></tr><tr><td>run_month_now_begin</td><td>String</td><td>the first day of the previous month where run_today is located, the format is yyyyMMdd</td><td>20240201</td></tr><tr><td>run_month_now_begin_std</td><td>String</td><td>The first day of the previous month where run_today is located (standard format), the format is yyyy-MM-dd</td><td>2024-02-01</td></tr><tr><td>run<!-- -->_<!-- -->month<!-- -->_<!-- -->end</td><td>String</td><td>The last day of the month where run_date belongs, in the format of yyyyMMdd</td><td>20240229</td></tr><tr><td>run<!-- -->_<!-- -->month<!-- -->_<!-- -->end<!-- -->_<!-- -->std</td><td>String</td><td>The last day of the month of run_date (standard date format), the format is yyyy-MM-dd</td><td>2024-02-29</td></tr><tr><td>run_month_now_end</td><td>String</td><td>the last day of the previous month where run_today is located, the format is yyyyMMdd</td><td>20240229</td></tr><tr><td>run_month_now_end_std</td><td>String</td><td>The last day of the previous month where run_today is located (standard date format), the format is yyyy-MM-dd</td><td>2024-02-29</td></tr><tr><td>run_quarter_begin</td><td>String</td><td>The first day of the quarter where run_date belongs, the format is yyyyMMdd</td><td>20240101</td></tr><tr><td>run_quarter_end</td><td>String</td><td>The last day of the quarter where run_date is located, in the format of yyyyMMdd</td><td>20240331</td></tr><tr><td>run_half_year_begin</td><td>String</td><td>The first day of the half year where run_date is located, the format is yyyyMMdd</td><td>20240101</td></tr><tr><td>run_half_year_end</td><td>String</td><td>The last day of the half year where run_date is located, the format is yyyyMMdd</td><td>20240630</td></tr><tr><td>run_year_begin</td><td>String</td><td>The first day of the year where run_date is located, the format is yyyyMMdd</td><td>20240101</td></tr><tr><td>run_year_end</td><td>String</td><td>The last day of the year where run_date is located, the format is yyyyMMdd</td><td>20241231</td></tr><tr><td>run_quarter_begin_std</td><td>String</td><td>The first day of the quarter where run_date belongs (standard format), the format is yyyy-MM-dd</td><td>2024-01-01</td></tr><tr><td>run_quarter_end_std</td><td>String</td><td>The last day of the quarter where run_date belongs (standard format), the format is yyyy-MM-dd</td><td>2024-03-31</td></tr><tr><td>run_half_year_begin_std</td><td>String</td><td>The first day of the half year where run_date is located (standard format), the format is yyyy-MM-dd</td><td>2024-01-01</td></tr><tr><td>run_half_year_end_std</td><td>String</td><td>The last day of the half year where run_date is located (standard format), the format is yyyy-MM-dd</td><td>2024-06-30</td></tr><tr><td>run_year_begin_std</td><td>String</td><td>The first day of the year where run_date is located (standard format), the format is yyyy-MM-dd</td><td>2024-01-01</td></tr><tr><td>run_year_end_std</td><td>String</td><td>The last day of the year of run_date (standard format), the format is yyyy-MM-dd</td><td>2024-12-31</td></tr><tr><td>run_tody_h</td><td>String</td><td>run_today task running time, yyyyMMddHH</td><td>2024030111</td></tr><tr><td>run_tody_h_std</td><td>String</td><td>The running time of the run_today task yyyy-MM-dd HH</td><td>2024-03-01 11</td></tr></tbody></table><p>details:</p><ol><li>run_date is a date variable that comes with the core, and supports user-defined dates. If not specified, it defaults to the day before the current system time.</li><li>Definition of other derived built-in date variables: other date built-in variables are calculated relative to run_date. Once run_date changes, the values of other variables will also change automatically. Other date variables do not support setting initial values and can only be modified by modifying run_date .</li><li>The built-in variables support richer usage scenarios: ${run_date-1} is the day before run_data; ${run_month_begin-1} is the first day of the previous month of run_month_begin, where -1 means minus one month.</li></ol><p>Take sql as an example:</p><div class="codeBlockContainer_Ckt0 theme-code-block" style="--prism-color:#F8F8F2;--prism-background-color:#282A36"><div class="codeBlockContent_biex"><pre tabindex="0" class="prism-code language-text codeBlock_bY9V thin-scrollbar"><code class="codeBlockLines_e6Vv"><span class="token-line" style="color:#F8F8F2"><span class="token plain">--@set run_date=20240229</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">select</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"${run_date}" as run_date,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"${run_date_std}" as run_date_std,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"${run_today}" as run_today,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"${run_today_std}" as run_today_std,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"${run_mon}" as run_mon,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"${run_mon_std}" as run_mon_std,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"${run_month_begin}" as run_month_begin,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"${run_month_begin_std}" as run_month_begin_std,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"${run_month_now_begin}" as run_month_now_begin,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"${run_month_now_begin_std}" as run_month_now_begin_std,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"${run_month_end}" as run_month_end,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"${run_month_end_std}" as run_month_end_std,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"${run_month_now_end}" as run_month_now_end,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"${run_month_now_end_std}" as run_month_now_end_std,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"${run_quarter_begin}" as run_quarter_begin,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"${run_quarter_end}" as run_quarter_end,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"${run_half_year_begin}" as run_half_year_begin,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"${run_half_year_end}" as run_half_year_end,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"${run_year_begin}" as run_year_begin,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"${run_year_end}" as run_year_end,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"${run_quarter_begin_std}" as run_quarter_begin_std,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"${run_quarter_end_std}" as run_quarter_end_std,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"${run_half_year_begin_std}" as run_half_year_begin_std,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"${run_half_year_end_std}" as run_half_year_end_std,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"${run_year_begin_std}" as run_year_begin_std,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"${run_year_end_std}" as run_year_end_std,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"${run_today_h}" as run_tody_h,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"${run_today_h_std}" as run_tody_h_std</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain" style="display:inline-block"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">Compile the replaced content:</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">select </span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"20240229" as run_date,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"2024-02-29" as run_date_std,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"20240301" as run_today,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"2024-03-01" as run_today_std, </span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"202402" as run_mon,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"2024-02" as run_mon_std,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"20240201" as run_month_begin,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"2024-02-01" as run_month_begin_std,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"20240201" as run_month_now_begin, </span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"2024-02-01" as run_month_now_begin_std,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"20240229" as run_month_end,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"2024-02-29" as run_month_end_std,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"20240229" as run_month_now_end,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"2024-02-29" as run_month_now_end_std, </span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"20240101" as run_quarter_begin,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"20240331" as run_quarter_end,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"20240101" as run_half_year_begin,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"20240630" as run_half_year_end,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"20240101" as run_year_begin, </span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"20241231" as run_year_end,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"2024-01-01" as run_quarter_begin_std,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"2024-03-31" as run_quarter_end_std,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"2024-01-01" as run_half_year_begin_std,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"2024-06-30" as run_half_year_end_std, </span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"2024-01-01" as run_year_begin_std,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"2024-12-31" as run_year_end_std,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"2024030111" as run_tody_h,</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">"2024-03-01 11" as run_tody_h_std</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain" style="display:inline-block"></span><br></span></code></pre><div class="buttonGroup__atx"><button type="button" aria-label="Copy code to clipboard" title="Copy" class="clean-btn"><span class="copyButtonIcons_eSgA" aria-hidden="true"><svg class="copyButtonIcon_y97N" viewBox="0 0 24 24"><path d="M19,21H8V7H19M19,5H8A2,2 0 0,0 6,7V21A2,2 0 0,0 8,23H19A2,2 0 0,0 21,21V7A2,2 0 0,0 19,5M16,1H4A2,2 0 0,0 2,3V17H4V3H16V1Z"></path></svg><svg class="copyButtonSuccessIcon_LjdS" viewBox="0 0 24 24"><path d="M21,7L9,19L3.5,13.5L4.91,12.09L9,16.17L19.59,5.59L21,7Z"></path></svg></span></button></div></div></div><h3 class="anchor anchorWithStickyNavbar_LWe7" id="22-custom-variables">2.2 Custom variables<a class="hash-link" href="#22-custom-variables" title="Direct link to heading"></a></h3><p> <!-- --> <!-- --> <!-- --> <!-- --> <!-- -->What are custom variables? User variables that are defined first and used later. User-defined variables temporarily support the definition of strings, integers, and floating-point variables. Strings support the + method, and integers and floating-point numbers support the +-*/ method. User-defined variables do not conflict with the set variable syntax supported by SparkSQL and HQL itself, but the same name is not allowed. How to define and use custom variables? as follows:</p><div class="codeBlockContainer_Ckt0 theme-code-block" style="--prism-color:#F8F8F2;--prism-background-color:#282A36"><div class="codeBlockContent_biex"><pre tabindex="0" class="prism-code language-text codeBlock_bY9V thin-scrollbar"><code class="codeBlockLines_e6Vv"><span class="token-line" style="color:#F8F8F2"><span class="token plain">## Defined in the code, specify before the task code</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">sql type definition method:</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">--@set f=20.1</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">The python/Shell type is defined as follows:</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">#@set f=20.1</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">Note: Only one line to define a variable is supported</span><br></span></code></pre><div class="buttonGroup__atx"><button type="button" aria-label="Copy code to clipboard" title="Copy" class="clean-btn"><span class="copyButtonIcons_eSgA" aria-hidden="true"><svg class="copyButtonIcon_y97N" viewBox="0 0 24 24"><path d="M19,21H8V7H19M19,5H8A2,2 0 0,0 6,7V21A2,2 0 0,0 8,23H19A2,2 0 0,0 21,21V7A2,2 0 0,0 19,5M16,1H4A2,2 0 0,0 2,3V17H4V3H16V1Z"></path></svg><svg class="copyButtonSuccessIcon_LjdS" viewBox="0 0 24 24"><path d="M21,7L9,19L3.5,13.5L4.91,12.09L9,16.17L19.59,5.59L21,7Z"></path></svg></span></button></div></div></div><p>The use is directly used in the code through <code>{varName expression}, such as ${f*2}</code></p><h3 class="anchor anchorWithStickyNavbar_LWe7" id="23-variable-scope">2.3 Variable scope<a class="hash-link" href="#23-variable-scope" title="Direct link to heading"></a></h3><p>Custom variables also have a scope in linkis, and the priority is that the variable defined in the script is greater than the Variable defined in the task parameter and greater than the built-in run_date variable. The task parameters are defined as follows:</p><div class="codeBlockContainer_Ckt0 theme-code-block" style="--prism-color:#F8F8F2;--prism-background-color:#282A36"><div class="codeBlockContent_biex"><pre tabindex="0" class="prism-code language-text codeBlock_bY9V thin-scrollbar"><code class="codeBlockLines_e6Vv"><span class="token-line" style="color:#F8F8F2"><span class="token plain">## restful</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">{</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> "executionContent": {"code": "select \"${f-1}\";", "runType": "sql"},</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> "params": {</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> "variable": {f: "20.1"},</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> "configuration": {</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> "runtime": {</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> "linkis.openlookeng.url":"http://127.0.0.1:9090"</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> }</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> }</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> },</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> "source": {"scriptPath": "file:///mnt/bdp/hadoop/1.sql"},</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> "labels": {</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> "engineType": "spark-2.4.3",</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> "userCreator": "hadoop-IDE"</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> }</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">}</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">## java SDK</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain">JobSubmitAction. builder</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> .addExecuteCode(code)</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> .setStartupParams(startupMap)</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> .setUser(user) //submit user</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> .addExecuteUser(user) //execute user</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> .setLabels(labels)</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> .setVariableMap(varMap) //setVar</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> .build</span><br></span></code></pre><div class="buttonGroup__atx"><button type="button" aria-label="Copy code to clipboard" title="Copy" class="clean-btn"><span class="copyButtonIcons_eSgA" aria-hidden="true"><svg class="copyButtonIcon_y97N" viewBox="0 0 24 24"><path d="M19,21H8V7H19M19,5H8A2,2 0 0,0 6,7V21A2,2 0 0,0 8,23H19A2,2 0 0,0 21,21V7A2,2 0 0,0 19,5M16,1H4A2,2 0 0,0 2,3V17H4V3H16V1Z"></path></svg><svg class="copyButtonSuccessIcon_LjdS" viewBox="0 0 24 24"><path d="M21,7L9,19L3.5,13.5L4.91,12.09L9,16.17L19.59,5.59L21,7Z"></path></svg></span></button></div></div></div><h2 class="anchor anchorWithStickyNavbar_LWe7" id="3-date-pattern-variable-introduction">3. Date Pattern variable introduction<a class="hash-link" href="#3-date-pattern-variable-introduction" title="Direct link to heading"></a></h2><h3 class="anchor anchorWithStickyNavbar_LWe7" id="31-features">3.1 Features<a class="hash-link" href="#31-features" title="Direct link to heading"></a></h3><ul><li>Support Pattern format time and users can specify it at will</li><li>Pattern date variables are calculated relative to run_date</li><li>Support ±y/±M/±d/±H etc.</li><li>Among them, +- is to operate on the linkis built-in parameter run_date first, and then replace the pattern field before %. Non-Pattern characters do not support operation and replacement.</li></ul><p>Pattern format comparison table:</p><table><thead><tr><th>Letter</th><th>Date or Time Component</th><th>Presentation</th><th>Examples</th></tr></thead><tbody><tr><td>G</td><td>Era designator</td><td>Text</td><td>AD</td></tr><tr><td>y</td><td>Year</td><td>Year</td><td>1996; 96</td></tr><tr><td>Y</td><td>Week year</td><td>Year</td><td>2009; 09</td></tr><tr><td>M</td><td>Month in year</td><td>Month</td><td>July; Jul; 07</td></tr><tr><td>w</td><td>Week in year</td><td>Number</td><td>27</td></tr><tr><td>W</td><td>Week in month</td><td>Number</td><td>2</td></tr><tr><td>D</td><td>Day in year</td><td>Number</td><td>189</td></tr><tr><td>d</td><td>Day in month</td><td>Number</td><td>10</td></tr><tr><td>F</td><td>Day of week in month</td><td>Number</td><td>2</td></tr><tr><td>E</td><td>Day name in week</td><td>Text</td><td>Tuesday; Tue</td></tr><tr><td>u</td><td>Day number of week (1 = Monday, …, 7 = Sunday)</td><td>Number</td><td>1</td></tr><tr><td>a</td><td>Am/pm marker</td><td>Text</td><td>PM</td></tr><tr><td>H</td><td>Hour in day (0-23)</td><td>Number</td><td>0</td></tr><tr><td>k</td><td>Hour in day (1-24)</td><td>Number</td><td>24</td></tr><tr><td>K</td><td>Hour in am/pm (0-11)</td><td>Number</td><td>0</td></tr><tr><td>h</td><td>Hour in am/pm (1-12)</td><td>Number</td><td>12</td></tr><tr><td>m</td><td>Minute in hour</td><td>Number</td><td>30</td></tr><tr><td>s</td><td>Second in minute</td><td>Number</td><td>55</td></tr><tr><td>S</td><td>Millisecond</td><td>Number</td><td>978</td></tr><tr><td>z</td><td>Time zone</td><td>General time zone</td><td>Pacific Standard Time; PST; GMT-08:00</td></tr><tr><td>Z</td><td>Time zone</td><td>RFC 822 time zone</td><td>-0800</td></tr><tr><td>X</td><td>Time zone</td><td>ISO 8601 time zone</td><td>-08; -0800; -08:00</td></tr></tbody></table><h3 class="anchor anchorWithStickyNavbar_LWe7" id="32-date-pattern-variable-example">3.2 Date Pattern variable example<a class="hash-link" href="#32-date-pattern-variable-example" title="Direct link to heading"></a></h3><p>You can define the parameters that need dynamic rendering according to your own preferences/business actual situation</p><table><thead><tr><th>variable</th><th>result</th></tr></thead><tbody><tr><td>&{yyyy-01-01}</td><td>2021-01-01</td></tr><tr><td>&{yyyy-01-01%-2y}</td><td>2019-01-01</td></tr><tr><td>&{yyyy-MM-01%-2M}</td><td>2021-02-01</td></tr><tr><td>&{yyyy-MM-dd%-2d}</td><td>2021-03-31</td></tr><tr><td>&{yyyy MM ----- HH%-1H}</td><td>2021 04 ----- 14</td></tr><tr><td>&{yyyyMMdd%-1d}</td><td>20210401</td></tr><tr><td>&{yyyyMM01%-1M}</td><td>20210301</td></tr><tr><td>&{HH%-1H}</td><td>14</td></tr></tbody></table><h3 class="anchor anchorWithStickyNavbar_LWe7" id="33-date-pattern-variable-usage-examples">3.3 Date Pattern variable usage examples<a class="hash-link" href="#33-date-pattern-variable-usage-examples" title="Direct link to heading"></a></h3><ul><li>Example 1: sql</li></ul><div class="language-sql codeBlockContainer_Ckt0 theme-code-block" style="--prism-color:#F8F8F2;--prism-background-color:#282A36"><div class="codeBlockContent_biex"><pre tabindex="0" class="prism-code language-sql codeBlock_bY9V thin-scrollbar"><code class="codeBlockLines_e6Vv"><span class="token-line" style="color:#F8F8F2"><span class="token keyword" style="color:rgb(189, 147, 249);font-style:italic">SELECT</span><span class="token plain"> </span><span class="token operator">*</span><span class="token plain"> </span><span class="token keyword" style="color:rgb(189, 147, 249);font-style:italic">FROM</span><span class="token plain"> hive</span><span class="token punctuation" style="color:rgb(248, 248, 242)">.</span><span class="token plain">tmp</span><span class="token punctuation" style="color:rgb(248, 248, 242)">.</span><span class="token plain">fund_nav_histories</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"></span><span class="token keyword" style="color:rgb(189, 147, 249);font-style:italic">WHERE</span><span class="token plain"> dt </span><span class="token operator"><=</span><span class="token plain"> DATE_FORMAT</span><span class="token punctuation" style="color:rgb(248, 248, 242)">(</span><span class="token plain">DATE_ADD</span><span class="token punctuation" style="color:rgb(248, 248, 242)">(</span><span class="token string" style="color:rgb(255, 121, 198)">'day'</span><span class="token punctuation" style="color:rgb(248, 248, 242)">,</span><span class="token plain"> </span><span class="token operator">-</span><span class="token number">1</span><span class="token punctuation" style="color:rgb(248, 248, 242)">,</span><span class="token plain"> </span><span class="token keyword" style="color:rgb(189, 147, 249);font-style:italic">DATE</span><span class="token punctuation" style="color:rgb(248, 248, 242)">(</span><span class="token plain">Date_parse</span><span class="token punctuation" style="color:rgb(248, 248, 242)">(</span><span class="token string" style="color:rgb(255, 121, 198)">'&{yyyyMMdd%-1d}'</span><span class="token punctuation" style="color:rgb(248, 248, 242)">,</span><span class="token plain"> </span><span class="token string" style="color:rgb(255, 121, 198)">'%Y%m%d'</span><span class="token punctuation" style="color:rgb(248, 248, 242)">)</span><span class="token punctuation" style="color:rgb(248, 248, 242)">)</span><span class="token punctuation" style="color:rgb(248, 248, 242)">)</span><span class="token punctuation" style="color:rgb(248, 248, 242)">,</span><span class="token plain"> </span><span class="token string" style="color:rgb(255, 121, 198)">'%Y%m%d'</span><span class="token punctuation" style="color:rgb(248, 248, 242)">)</span><br></span></code></pre><div class="buttonGroup__atx"><button type="button" aria-label="Copy code to clipboard" title="Copy" class="clean-btn"><span class="copyButtonIcons_eSgA" aria-hidden="true"><svg class="copyButtonIcon_y97N" viewBox="0 0 24 24"><path d="M19,21H8V7H19M19,5H8A2,2 0 0,0 6,7V21A2,2 0 0,0 8,23H19A2,2 0 0,0 21,21V7A2,2 0 0,0 19,5M16,1H4A2,2 0 0,0 2,3V17H4V3H16V1Z"></path></svg><svg class="copyButtonSuccessIcon_LjdS" viewBox="0 0 24 24"><path d="M21,7L9,19L3.5,13.5L4.91,12.09L9,16.17L19.59,5.59L21,7Z"></path></svg></span></button></div></div></div><p>after rendering</p><div class="language-sql codeBlockContainer_Ckt0 theme-code-block" style="--prism-color:#F8F8F2;--prism-background-color:#282A36"><div class="codeBlockContent_biex"><pre tabindex="0" class="prism-code language-sql codeBlock_bY9V thin-scrollbar"><code class="codeBlockLines_e6Vv"><span class="token-line" style="color:#F8F8F2"><span class="token keyword" style="color:rgb(189, 147, 249);font-style:italic">SELECT</span><span class="token plain"> </span><span class="token operator">*</span><span class="token plain"> </span><span class="token keyword" style="color:rgb(189, 147, 249);font-style:italic">FROM</span><span class="token plain"> hive</span><span class="token punctuation" style="color:rgb(248, 248, 242)">.</span><span class="token plain">tmp</span><span class="token punctuation" style="color:rgb(248, 248, 242)">.</span><span class="token plain">fund_nav_histories</span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"></span><span class="token keyword" style="color:rgb(189, 147, 249);font-style:italic">WHERE</span><span class="token plain"> dt </span><span class="token operator"><=</span><span class="token plain"> DATE_FORMAT</span><span class="token punctuation" style="color:rgb(248, 248, 242)">(</span><span class="token plain">DATE_ADD</span><span class="token punctuation" style="color:rgb(248, 248, 242)">(</span><span class="token string" style="color:rgb(255, 121, 198)">'day'</span><span class="token punctuation" style="color:rgb(248, 248, 242)">,</span><span class="token plain"> </span><span class="token operator">-</span><span class="token number">1</span><span class="token punctuation" style="color:rgb(248, 248, 242)">,</span><span class="token plain"> </span><span class="token keyword" style="color:rgb(189, 147, 249);font-style:italic">DATE</span><span class="token punctuation" style="color:rgb(248, 248, 242)">(</span><span class="token plain">Date_parse</span><span class="token punctuation" style="color:rgb(248, 248, 242)">(</span><span class="token string" style="color:rgb(255, 121, 198)">'20220705'</span><span class="token punctuation" style="color:rgb(248, 248, 242)">,</span><span class="token plain"> </span><span class="token string" style="color:rgb(255, 121, 198)">'%Y%m%d'</span><span class="token punctuation" style="color:rgb(248, 248, 242)">)</span><span class="token punctuation" style="color:rgb(248, 248, 242)">)</span><span class="token punctuation" style="color:rgb(248, 248, 242)">)</span><span class="token punctuation" style="color:rgb(248, 248, 242)">,</span><span class="token plain"> </span><span class="token string" style="color:rgb(255, 121, 198)">'%Y%m%d'</span><span class="token punctuation" style="color:rgb(248, 248, 242)">)</span><br></span></code></pre><div class="buttonGroup__atx"><button type="button" aria-label="Copy code to clipboard" title="Copy" class="clean-btn"><span class="copyButtonIcons_eSgA" aria-hidden="true"><svg class="copyButtonIcon_y97N" viewBox="0 0 24 24"><path d="M19,21H8V7H19M19,5H8A2,2 0 0,0 6,7V21A2,2 0 0,0 8,23H19A2,2 0 0,0 21,21V7A2,2 0 0,0 19,5M16,1H4A2,2 0 0,0 2,3V17H4V3H16V1Z"></path></svg><svg class="copyButtonSuccessIcon_LjdS" viewBox="0 0 24 24"><path d="M21,7L9,19L3.5,13.5L4.91,12.09L9,16.17L19.59,5.59L21,7Z"></path></svg></span></button></div></div></div><ul><li>Example 2: shell</li></ul><div class="language-shell codeBlockContainer_Ckt0 theme-code-block" style="--prism-color:#F8F8F2;--prism-background-color:#282A36"><div class="codeBlockContent_biex"><pre tabindex="0" class="prism-code language-shell codeBlock_bY9V thin-scrollbar"><code class="codeBlockLines_e6Vv"><span class="token-line" style="color:#F8F8F2"><span class="token plain">aws s3 </span><span class="token function" style="color:rgb(80, 250, 123)">ls</span><span class="token plain"> s3://***/ads/tmp/dws_member_active_detail_d_20210601_20211231/pt</span><span class="token operator">=</span><span class="token operator">&</span><span class="token punctuation" style="color:rgb(248, 248, 242)">{</span><span class="token plain">yyyyMMdd%-1d</span><span class="token punctuation" style="color:rgb(248, 248, 242)">}</span><span class="token plain">/</span><br></span></code></pre><div class="buttonGroup__atx"><button type="button" aria-label="Copy code to clipboard" title="Copy" class="clean-btn"><span class="copyButtonIcons_eSgA" aria-hidden="true"><svg class="copyButtonIcon_y97N" viewBox="0 0 24 24"><path d="M19,21H8V7H19M19,5H8A2,2 0 0,0 6,7V21A2,2 0 0,0 8,23H19A2,2 0 0,0 21,21V7A2,2 0 0,0 19,5M16,1H4A2,2 0 0,0 2,3V17H4V3H16V1Z"></path></svg><svg class="copyButtonSuccessIcon_LjdS" viewBox="0 0 24 24"><path d="M21,7L9,19L3.5,13.5L4.91,12.09L9,16.17L19.59,5.59L21,7Z"></path></svg></span></button></div></div></div><p>after rendering</p><div class="language-shell codeBlockContainer_Ckt0 theme-code-block" style="--prism-color:#F8F8F2;--prism-background-color:#282A36"><div class="codeBlockContent_biex"><pre tabindex="0" class="prism-code language-shell codeBlock_bY9V thin-scrollbar"><code class="codeBlockLines_e6Vv"><span class="token-line" style="color:#F8F8F2"><span class="token plain">aws s3 </span><span class="token function" style="color:rgb(80, 250, 123)">ls</span><span class="token plain"> s3://***/ads/tmp/dws_member_active_detail_d_20210601_20211231/pt</span><span class="token operator">=</span><span class="token number">20220705</span><span class="token plain">/</span><br></span></code></pre><div class="buttonGroup__atx"><button type="button" aria-label="Copy code to clipboard" title="Copy" class="clean-btn"><span class="copyButtonIcons_eSgA" aria-hidden="true"><svg class="copyButtonIcon_y97N" viewBox="0 0 24 24"><path d="M19,21H8V7H19M19,5H8A2,2 0 0,0 6,7V21A2,2 0 0,0 8,23H19A2,2 0 0,0 21,21V7A2,2 0 0,0 19,5M16,1H4A2,2 0 0,0 2,3V17H4V3H16V1Z"></path></svg><svg class="copyButtonSuccessIcon_LjdS" viewBox="0 0 24 24"><path d="M21,7L9,19L3.5,13.5L4.91,12.09L9,16.17L19.59,5.59L21,7Z"></path></svg></span></button></div></div></div><ul><li>Example 3: datax json</li></ul><div class="language-json codeBlockContainer_Ckt0 theme-code-block" style="--prism-color:#F8F8F2;--prism-background-color:#282A36"><div class="codeBlockContent_biex"><pre tabindex="0" class="prism-code language-json codeBlock_bY9V thin-scrollbar"><code class="codeBlockLines_e6Vv"><span class="token-line" style="color:#F8F8F2"><span class="token punctuation" style="color:rgb(248, 248, 242)">{</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token property">"job"</span><span class="token operator">:</span><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">{</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token property">"setting"</span><span class="token operator">:</span><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">{</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token property">"speed"</span><span class="token operator">:</span><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">{</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token property">"channel"</span><span class="token operator">:</span><span class="token plain"> </span><span class="token number">1</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">}</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">}</span><span class="token punctuation" style="color:rgb(248, 248, 242)">,</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token property">"content"</span><span class="token operator">:</span><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">[</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">{</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token property">"reader"</span><span class="token operator">:</span><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">{</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token property">"name"</span><span class="token operator">:</span><span class="token plain"> </span><span class="token string" style="color:rgb(255, 121, 198)">"s3reader"</span><span class="token punctuation" style="color:rgb(248, 248, 242)">,</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token property">"parameter"</span><span class="token operator">:</span><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">{</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token property">"bucket"</span><span class="token operator">:</span><span class="token plain"> </span><span class="token string" style="color:rgb(255, 121, 198)">"**************"</span><span class="token punctuation" style="color:rgb(248, 248, 242)">,</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token property">"path"</span><span class="token operator">:</span><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">[</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token string" style="color:rgb(255, 121, 198)">"ads/tmp/ccass_tm_announcements/&{yyyyMMdd%-1d}/"</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">]</span><span class="token punctuation" style="color:rgb(248, 248, 242)">,</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token property">"stored"</span><span class="token operator">:</span><span class="token plain"> </span><span class="token string" style="color:rgb(255, 121, 198)">"parquet"</span><span class="token punctuation" style="color:rgb(248, 248, 242)">,</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token property">"compression"</span><span class="token operator">:</span><span class="token plain"> </span><span class="token string" style="color:rgb(255, 121, 198)">"NONE"</span><span class="token punctuation" style="color:rgb(248, 248, 242)">,</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token property">"column"</span><span class="token operator">:</span><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">[</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">{</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token property">"index"</span><span class="token operator">:</span><span class="token plain"> </span><span class="token number">0</span><span class="token punctuation" style="color:rgb(248, 248, 242)">,</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token property">"type"</span><span class="token operator">:</span><span class="token plain"> </span><span class="token string" style="color:rgb(255, 121, 198)">"int"</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">}</span><span class="token punctuation" style="color:rgb(248, 248, 242)">,</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">{</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token property">"index"</span><span class="token operator">:</span><span class="token plain"> </span><span class="token number">1</span><span class="token punctuation" style="color:rgb(248, 248, 242)">,</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token property">"type"</span><span class="token operator">:</span><span class="token plain"> </span><span class="token string" style="color:rgb(255, 121, 198)">"string"</span><span class="token punctuation" style="color:rgb(248, 248, 242)">,</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token property">"constant"</span><span class="token operator">:</span><span class="token plain"> </span><span class="token string" style="color:rgb(255, 121, 198)">"&{yyyyMMdd%-1d}"</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">}</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">]</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">}</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">}</span><span class="token punctuation" style="color:rgb(248, 248, 242)">,</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token property">"writer"</span><span class="token operator">:</span><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">{</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token property">"name"</span><span class="token operator">:</span><span class="token plain"> </span><span class="token string" style="color:rgb(255, 121, 198)">"streamwriter"</span><span class="token punctuation" style="color:rgb(248, 248, 242)">,</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token property">"parameter"</span><span class="token operator">:</span><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">{</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token property">"print"</span><span class="token operator">:</span><span class="token plain"> </span><span class="token boolean">true</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">}</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">}</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">}</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">]</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">}</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"></span><span class="token punctuation" style="color:rgb(248, 248, 242)">}</span><br></span></code></pre><div class="buttonGroup__atx"><button type="button" aria-label="Copy code to clipboard" title="Copy" class="clean-btn"><span class="copyButtonIcons_eSgA" aria-hidden="true"><svg class="copyButtonIcon_y97N" viewBox="0 0 24 24"><path d="M19,21H8V7H19M19,5H8A2,2 0 0,0 6,7V21A2,2 0 0,0 8,23H19A2,2 0 0,0 21,21V7A2,2 0 0,0 19,5M16,1H4A2,2 0 0,0 2,3V17H4V3H16V1Z"></path></svg><svg class="copyButtonSuccessIcon_LjdS" viewBox="0 0 24 24"><path d="M21,7L9,19L3.5,13.5L4.91,12.09L9,16.17L19.59,5.59L21,7Z"></path></svg></span></button></div></div></div><p>after rendering</p><div class="language-json codeBlockContainer_Ckt0 theme-code-block" style="--prism-color:#F8F8F2;--prism-background-color:#282A36"><div class="codeBlockContent_biex"><pre tabindex="0" class="prism-code language-json codeBlock_bY9V thin-scrollbar"><code class="codeBlockLines_e6Vv"><span class="token-line" style="color:#F8F8F2"><span class="token punctuation" style="color:rgb(248, 248, 242)">{</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token property">"job"</span><span class="token operator">:</span><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">{</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token property">"setting"</span><span class="token operator">:</span><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">{</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token property">"speed"</span><span class="token operator">:</span><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">{</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token property">"channel"</span><span class="token operator">:</span><span class="token plain"> </span><span class="token number">1</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">}</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">}</span><span class="token punctuation" style="color:rgb(248, 248, 242)">,</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token property">"content"</span><span class="token operator">:</span><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">[</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">{</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token property">"reader"</span><span class="token operator">:</span><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">{</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token property">"name"</span><span class="token operator">:</span><span class="token plain"> </span><span class="token string" style="color:rgb(255, 121, 198)">"s3reader"</span><span class="token punctuation" style="color:rgb(248, 248, 242)">,</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token property">"parameter"</span><span class="token operator">:</span><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">{</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token property">"bucket"</span><span class="token operator">:</span><span class="token plain"> </span><span class="token string" style="color:rgb(255, 121, 198)">"**************"</span><span class="token punctuation" style="color:rgb(248, 248, 242)">,</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token property">"path"</span><span class="token operator">:</span><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">[</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token string" style="color:rgb(255, 121, 198)">"ads/tmp/ccass_tm_announcements/20220705/"</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">]</span><span class="token punctuation" style="color:rgb(248, 248, 242)">,</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token property">"stored"</span><span class="token operator">:</span><span class="token plain"> </span><span class="token string" style="color:rgb(255, 121, 198)">"parquet"</span><span class="token punctuation" style="color:rgb(248, 248, 242)">,</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token property">"compression"</span><span class="token operator">:</span><span class="token plain"> </span><span class="token string" style="color:rgb(255, 121, 198)">"NONE"</span><span class="token punctuation" style="color:rgb(248, 248, 242)">,</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token property">"column"</span><span class="token operator">:</span><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">[</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">{</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token property">"index"</span><span class="token operator">:</span><span class="token plain"> </span><span class="token number">0</span><span class="token punctuation" style="color:rgb(248, 248, 242)">,</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token property">"type"</span><span class="token operator">:</span><span class="token plain"> </span><span class="token string" style="color:rgb(255, 121, 198)">"int"</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">}</span><span class="token punctuation" style="color:rgb(248, 248, 242)">,</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">{</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token property">"index"</span><span class="token operator">:</span><span class="token plain"> </span><span class="token number">1</span><span class="token punctuation" style="color:rgb(248, 248, 242)">,</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token property">"type"</span><span class="token operator">:</span><span class="token plain"> </span><span class="token string" style="color:rgb(255, 121, 198)">"string"</span><span class="token punctuation" style="color:rgb(248, 248, 242)">,</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token property">"constant"</span><span class="token operator">:</span><span class="token plain"> </span><span class="token string" style="color:rgb(255, 121, 198)">"20220705"</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">}</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">]</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">}</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">}</span><span class="token punctuation" style="color:rgb(248, 248, 242)">,</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token property">"writer"</span><span class="token operator">:</span><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">{</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token property">"name"</span><span class="token operator">:</span><span class="token plain"> </span><span class="token string" style="color:rgb(255, 121, 198)">"streamwriter"</span><span class="token punctuation" style="color:rgb(248, 248, 242)">,</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token property">"parameter"</span><span class="token operator">:</span><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">{</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token property">"print"</span><span class="token operator">:</span><span class="token plain"> </span><span class="token boolean">true</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">}</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">}</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">}</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">]</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"> </span><span class="token punctuation" style="color:rgb(248, 248, 242)">}</span><span class="token plain"></span><br></span><span class="token-line" style="color:#F8F8F2"><span class="token plain"></span><span class="token punctuation" style="color:rgb(248, 248, 242)">}</span><br></span></code></pre><div class="buttonGroup__atx"><button type="button" aria-label="Copy code to clipboard" title="Copy" class="clean-btn"><span class="copyButtonIcons_eSgA" aria-hidden="true"><svg class="copyButtonIcon_y97N" viewBox="0 0 24 24"><path d="M19,21H8V7H19M19,5H8A2,2 0 0,0 6,7V21A2,2 0 0,0 8,23H19A2,2 0 0,0 21,21V7A2,2 0 0,0 19,5M16,1H4A2,2 0 0,0 2,3V17H4V3H16V1Z"></path></svg><svg class="copyButtonSuccessIcon_LjdS" viewBox="0 0 24 24"><path d="M21,7L9,19L3.5,13.5L4.91,12.09L9,16.17L19.59,5.59L21,7Z"></path></svg></span></button></div></div></div><ul><li>Example 4:python</li></ul><div class="language-python codeBlockContainer_Ckt0 theme-code-block" style="--prism-color:#F8F8F2;--prism-background-color:#282A36"><div class="codeBlockContent_biex"><pre tabindex="0" class="prism-code language-python codeBlock_bY9V thin-scrollbar"><code class="codeBlockLines_e6Vv"><span class="token-line" style="color:#F8F8F2"><span class="token keyword" style="color:rgb(189, 147, 249);font-style:italic">print</span><span class="token punctuation" style="color:rgb(248, 248, 242)">(</span><span class="token operator">&</span><span class="token punctuation" style="color:rgb(248, 248, 242)">{</span><span class="token plain">yyyyMMdd</span><span class="token operator">%</span><span class="token operator">-</span><span class="token plain">1d</span><span class="token punctuation" style="color:rgb(248, 248, 242)">}</span><span class="token punctuation" style="color:rgb(248, 248, 242)">)</span><br></span></code></pre><div class="buttonGroup__atx"><button type="button" aria-label="Copy code to clipboard" title="Copy" class="clean-btn"><span class="copyButtonIcons_eSgA" aria-hidden="true"><svg class="copyButtonIcon_y97N" viewBox="0 0 24 24"><path d="M19,21H8V7H19M19,5H8A2,2 0 0,0 6,7V21A2,2 0 0,0 8,23H19A2,2 0 0,0 21,21V7A2,2 0 0,0 19,5M16,1H4A2,2 0 0,0 2,3V17H4V3H16V1Z"></path></svg><svg class="copyButtonSuccessIcon_LjdS" viewBox="0 0 24 24"><path d="M21,7L9,19L3.5,13.5L4.91,12.09L9,16.17L19.59,5.59L21,7Z"></path></svg></span></button></div></div></div><p>after rendering</p><div class="codeBlockContainer_Ckt0 theme-code-block" style="--prism-color:#F8F8F2;--prism-background-color:#282A36"><div class="codeBlockContent_biex"><pre tabindex="0" class="prism-code language-text codeBlock_bY9V thin-scrollbar"><code class="codeBlockLines_e6Vv"><span class="token-line" style="color:#F8F8F2"><span class="token plain"> 20220705</span><br></span></code></pre><div class="buttonGroup__atx"><button type="button" aria-label="Copy code to clipboard" title="Copy" class="clean-btn"><span class="copyButtonIcons_eSgA" aria-hidden="true"><svg class="copyButtonIcon_y97N" viewBox="0 0 24 24"><path d="M19,21H8V7H19M19,5H8A2,2 0 0,0 6,7V21A2,2 0 0,0 8,23H19A2,2 0 0,0 21,21V7A2,2 0 0,0 19,5M16,1H4A2,2 0 0,0 2,3V17H4V3H16V1Z"></path></svg><svg class="copyButtonSuccessIcon_LjdS" viewBox="0 0 24 24"><path d="M21,7L9,19L3.5,13.5L4.91,12.09L9,16.17L19.59,5.59L21,7Z"></path></svg></span></button></div></div></div></div><footer class="theme-doc-footer docusaurus-mt-lg"><div class="theme-doc-footer-edit-meta-row row"><div class="col"><a href="https://github.com/apache/linkis-website/edit/dev/versioned_docs/version-1.3.0/user-guide/dynamic-variables.md" target="_blank" rel="noreferrer noopener" class="theme-edit-this-page"><svg fill="currentColor" height="20" width="20" viewBox="0 0 40 40" class="iconEdit_Z9Sw" aria-hidden="true"><g><path d="m34.5 11.7l-3 3.1-6.3-6.3 3.1-3q0.5-0.5 1.2-0.5t1.1 0.5l3.9 3.9q0.5 0.4 0.5 1.1t-0.5 1.2z m-29.5 17.1l18.4-18.5 6.3 6.3-18.4 18.4h-6.3v-6.2z"></path></g></svg>Edit this page</a></div><div class="col lastUpdated_vwxv"></div></div></footer></article><nav class="pagination-nav docusaurus-mt-lg" aria-label="Docs pages navigation"><a class="pagination-nav__link pagination-nav__link--prev" href="/docs/1.3.0/user-guide/datasource-client"><div class="pagination-nav__sublabel">Previous</div><div class="pagination-nav__label">Data Source Client SDK</div></a><a class="pagination-nav__link pagination-nav__link--next" href="/docs/1.3.0/user-guide/datasource-manual"><div class="pagination-nav__sublabel">Next</div><div class="pagination-nav__label">Data Source Manual</div></a></nav></div></div><div class="col col--3"><div class="tableOfContents_bqdL thin-scrollbar theme-doc-toc-desktop"><ul class="table-of-contents table-of-contents__left-border"><li><a href="#1-overview" class="table-of-contents__link toc-highlight">1. Overview</a><ul><li><a href="#need" class="table-of-contents__link toc-highlight">need</a></li><li><a href="#target" class="table-of-contents__link toc-highlight">Target</a></li></ul></li><li><a href="#2-custom-variable-function-introduction" class="table-of-contents__link toc-highlight">2 Custom variable function introduction</a><ul><li><a href="#21-built-in-variables" class="table-of-contents__link toc-highlight">2.1 Built-in variables</a></li><li><a href="#22-custom-variables" class="table-of-contents__link toc-highlight">2.2 Custom variables</a></li><li><a href="#23-variable-scope" class="table-of-contents__link toc-highlight">2.3 Variable scope</a></li></ul></li><li><a href="#3-date-pattern-variable-introduction" class="table-of-contents__link toc-highlight">3. Date Pattern variable introduction</a><ul><li><a href="#31-features" class="table-of-contents__link toc-highlight">3.1 Features</a></li><li><a href="#32-date-pattern-variable-example" class="table-of-contents__link toc-highlight">3.2 Date Pattern variable example</a></li><li><a href="#33-date-pattern-variable-usage-examples" class="table-of-contents__link toc-highlight">3.3 Date Pattern variable usage examples</a></li></ul></li></ul></div></div></div></div></main></div></div><footer class="footer"><div class="container container-fluid"><div class="row footer__links"><div class="col footer__col"><div class="footer__title">Linkis</div><ul class="footer__items clean-list"><li class="footer__item"><a class="footer__link-item" href="/docs/latest/about/introduction">Document</a></li><li class="footer__item"><a class="footer__link-item" href="/faq/main">FAQ</a></li><li class="footer__item"><a href="https://github.com/apache/linkis/releases" target="_blank" rel="noopener noreferrer" class="footer__link-item">Releases</a></li></ul></div><div class="col footer__col"><div class="footer__title">Community</div><ul class="footer__items clean-list"><li class="footer__item"><a href="https://github.com/apache/linkis" target="_blank" rel="noopener noreferrer" class="footer__link-item">GitHub</a></li><li class="footer__item"><a href="https://github.com/apache/linkis/issues" target="_blank" rel="noopener noreferrer" class="footer__link-item">Issue Tracker</a></li><li class="footer__item"><a href="https://github.com/apache/linkis/pulls" target="_blank" rel="noopener noreferrer" class="footer__link-item">Pull Requests</a></li></ul></div><div class="col footer__col"><div class="footer__title">Subscribe Mailing List</div><ul class="footer__items clean-list"><li class="footer__item"><a class="footer__link-item" href="/community/how-to-subscribe">How to Subscribe</a></li><li class="footer__item"><a href="mailto:dev-subscribe@linkis.apache.org" target="_blank" rel="noopener noreferrer" class="footer__link-item">Subscribe Mail</a></li><li class="footer__item"><a href="https://lists.apache.org/list.html?dev@linkis.apache.org" target="_blank" rel="noopener noreferrer" class="footer__link-item">Mail Archive</a></li></ul></div></div><div class="footer__bottom text--center"><div class="footer__copyright"><div><img style="height:50px" alt="Apache Software Foundation" src="/img/incubator-logo.svg"><p style="color: #999999; padding: 0 20px 30px;font-weight:400;text-align:left">Apache Linkis is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the Apache Incubator. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF.</p><p></p> |