You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-01 - 20:13
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Fri May 01, 2026 12:44:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
25402391070,4EcMasterDemoSyn25408-21ps10:45:353
1451739910,0EcMasterDemoSyn1452729tAtEmLog_008:08:245
1012439850,0EcMasterDemoSyn1013629tAtEmLog_012:06:435
1918839840,0EcMasterDemoSyn1919829tAtEmLog_009:49:495
3019839830,0EcMasterDemoSyn3020829tAtEmLog_007:32:555
3255539820,0EcMasterDemoSyn3256529tAtEmLog_007:37:595
312882820,0sleep30-21swapper/311:25:143
2458039820,0EcMasterDemoSyn2459029tAtEmLog_011:21:065
1924239820,0EcMasterDemoSyn1925229tAtEmLog_008:18:335
1687439820,0EcMasterDemoSyn1688429tAtEmLog_008:13:295
1216239820,0EcMasterDemoSyn1217229tAtEmLog_008:03:205
506439810,0EcMasterDemoSyn507429tAtEmLog_007:48:075
2540239810,0EcMasterDemoSyn2541229tAtEmLog_010:45:355
2316639810,0EcMasterDemoSyn2317629tAtEmLog_012:32:045
102439810,0EcMasterDemoSyn103429tAtEmLog_012:01:405
191492800,0sleep20-21swapper/210:42:352
191492800,0sleep20-21swapper/210:42:342
373639660,1EcMasterDemoSyn3745-21wc08:54:023
83802350,0sleep20-21swapper/211:30:122
2842439250,1EcMasterDemoSyn28433-21wc09:19:230
1799099230,9cyclictest22060-21sh11:20:130
1799099220,11cyclictest17461-21cat11:00:010
1799099220,11cyclictest17461-21cat11:00:000
1799099213,10cyclictest12577-21sed09:10:170
1799099213,10cyclictest12577-21sed09:10:160
17990992112,3cyclictest26896-21cut11:40:160
1799099210,7cyclictest16305-21ssh11:16:370
1799099210,10cyclictest31638-21ssh10:49:580
1799099210,10cyclictest29234-21sh10:30:160
1799099201,11cyclictest22325-21chrt11:38:010
17990992010,2cyclictest18345-21sh12:29:590
1799099200,9cyclictest6389-21ssh09:42:120
1799099200,9cyclictest12543-21cat09:45:240
1799099200,7cyclictest21390-21sh12:13:200
1799099200,11cyclictest11345-21diskmemload10:38:420
1799099200,10cyclictest3581-21runrttasks07:45:140
1799099200,10cyclictest31640-21sh11:07:180
1799099200,10cyclictest26474-21sh10:10:500
1799099200,10cyclictest24869-21sh09:52:260
501329190,0tAtEmLog_00-21swapper/512:27:005
1799099191,9cyclictest31391-21/usr/sbin/munin09:20:210
1799099191,9cyclictest20299-21sh11:00:440
1799099191,9cyclictest20299-21sh11:00:440
1799099190,9cyclictest780-21runrttasks07:10:140
1799099190,9cyclictest5691-21ssh11:29:120
1799099190,9cyclictest4323-21chrt09:59:250
1799099190,9cyclictest3378-21ssh10:15:460
1799099190,9cyclictest31911-21ssh12:19:250
1799099190,9cyclictest24026-21taskset08:28:480
1799099190,9cyclictest22060-21ssh10:26:110
1799099190,9cyclictest20815-21sh10:08:130
1799099190,7cyclictest5603-21sh11:10:290
1799099190,7cyclictest24502-21sh12:33:010
1799099190,11cyclictest3546-21sh10:51:370
1799099190,11cyclictest3546-21sh10:51:370
1799099190,11cyclictest21854-21ntpq11:55:170
1799099190,10cyclictest7936-21ssh10:00:340
1799099190,10cyclictest716-21snmpd09:36:180
1799099190,10cyclictest6256-21sh12:05:080
1799099190,10cyclictest5181-21sh11:45:490
1799099190,10cyclictest14568-21sh11:51:070
43929180,10tAtEmLog_01254-21taskset09:40:005
1799999184,10cyclictest8666-21ssh12:05:422
1799599181,12cyclictest16-1pr/legacy11:41:221
1799099180,9cyclictest780-21runrttasks07:38:460
1799099180,9cyclictest20915-21ssh10:43:500
1799099180,9cyclictest20915-21ssh10:43:490
1799099180,9cyclictest11749-21ssh11:31:530
1799099180,14cyclictest10098-21sh09:26:280
1799099180,10cyclictest32689-21rm12:01:080
629799170,10tDemoTimingTask6406-21chrt11:11:005
615699170,7tDemoTimingTask8242-21chrt09:00:295
28435991715,0tDemoTimingTask0-21swapper/509:20:005
2640229170,7tAtEmLog_026449-21chrt08:34:005
1800899175,8cyclictest711-21gdbus10:20:194
1800899171,12cyclictest16-1pr/legacy11:05:524
1799999174,9cyclictest711-21gdbus08:35:192
1799999174,8cyclictest634-21ssh12:20:012
1799999174,8cyclictest4560-21ssh10:52:212
1799999174,8cyclictest4560-21ssh10:52:202
1799999174,8cyclictest24304-21df10:10:122
1799999174,8cyclictest10016-21taskset09:26:252
1799999173,9cyclictest19152-21/usr/sbin/munin11:00:202
1799999173,9cyclictest19152-21/usr/sbin/munin11:00:192
1799999173,10cyclictest28129-21sh11:59:172
1799999171,12cyclictest16-1pr/legacy08:33:442
1799099170,9cyclictest6456-21sh12:22:570
1799099170,13cyclictest780-21runrttasks08:34:410
674929160,7tAtEmLog_07277-21taskset10:35:485
2998799160,9tDemoTimingTask30007-21taskset10:30:245
2906399160,9tDemoTimingTask29173-21taskset08:39:565
1800899169,6cyclictest12199-21tail09:10:154
1800899169,6cyclictest12199-21tail09:10:144
1800899160,9cyclictest16110-21ssh10:59:094
1800899160,9cyclictest16110-21ssh10:59:084
1800499161,11cyclictest16-1pr/legacy07:43:033
1800499160,9cyclictest22592-21chrt07:15:493
1800499160,9cyclictest22592-21chrt07:15:483
1800499160,13cyclictest326-21systemd-journal09:37:283
1799999165,6cyclictest3352-21grep08:50:242
1799999165,6cyclictest25530-21ssh11:21:412
1799999165,6cyclictest21003-21cut09:15:122
1799999164,8cyclictest9787-21ssh11:49:042
1799999164,8cyclictest8015-21ssh10:00:372
1799999164,8cyclictest688-21ssh11:25:442
1799999164,8cyclictest3508-21ssh12:39:452
1799999164,8cyclictest31850-21taskset09:20:252
1799999164,8cyclictest30445-21taskset12:18:222
1799999164,8cyclictest25178-21taskset09:52:372
1799999164,8cyclictest2348-21ssh10:15:202
1799999163,9cyclictest29035-21grep11:41:222
1799999163,9cyclictest2335-21sh11:09:312
1799999163,9cyclictest13343-21cat08:05:172
1799999163,8cyclictest6898-21sh10:35:322
1799999162,8cyclictest11120-21sed08:00:162
1799599164,9cyclictest716-21snmpd09:35:401
1799599164,9cyclictest19117-21cat07:10:171
1799599160,9cyclictest22802-21sh11:38:221
1799099160,9cyclictest780-21runrttasks08:00:500
1799099160,9cyclictest780-21runrttasks07:51:240
1799099160,9cyclictest780-21runrttasks07:24:330
1072299160,9tDemoTimingTask10731-21taskset10:20:165
1918999150,9tDemoTimingTask14760-21sleep12:14:555
18008991512,2cyclictest7604-21turbostat07:55:004
18008991512,2cyclictest10194-21kworker/4:2+events11:00:484
18008991512,2cyclictest10194-21kworker/4:2+events11:00:474
1800499154,8cyclictest8564-21wc09:04:153
1800499152,9cyclictest31891-21ssh12:36:533
1800499151,10cyclictest19354-21ssh11:54:293
1800499150,9cyclictest19278-21ps08:18:363
1800499150,9cyclictest1047-21/usr/sbin/munin10:50:173
1800499150,9cyclictest1047-21/usr/sbin/munin10:50:163
1799999157,6cyclictest25517-21tail09:35:152
1799999155,8cyclictest9871-21sh10:20:082
1799999155,8cyclictest780-21runrttasks07:57:572
1799999155,8cyclictest32222-21ssh10:31:572
1799999155,8cyclictest29295-21sh10:48:182
1799999155,8cyclictest19402-21sh11:35:572
1799999154,6cyclictest780-21runrttasks07:15:472
1799999154,6cyclictest780-21runrttasks07:15:472
1799999154,6cyclictest32440-21grep08:45:152
1799999154,6cyclictest3094-21latency_hist07:45:022
1799999154,6cyclictest16480-21ssh12:10:172
1799999153,8cyclictest6843-21ssh11:11:202
1799999153,8cyclictest30457-21latency_hist07:35:002
1799999153,8cyclictest24298-21cut08:30:002
1799999153,8cyclictest21438-21ssh09:33:032
1799999153,8cyclictest20227-21ssh10:25:192
1799999153,8cyclictest1960-21ssh09:57:442
1799999153,8cyclictest19407-21latency_hist08:20:002
1799999153,8cyclictest19363-21fschecks_count12:30:142
1799999153,8cyclictest18423-21ssh09:49:182
1799999153,8cyclictest17749-21sh11:53:212
1799999153,8cyclictest1700-21ssh09:40:042
1799999153,8cyclictest12425-21ssh12:25:482
1799999153,6cyclictest4462-21python307:45:232
1799999152,9cyclictest19817-21ssh10:07:322
1799999152,8cyclictest2066-21ssh12:02:212
1799999152,8cyclictest12361-21ssh11:15:012
1799599157,7cyclictest17986-21cyclictest08:35:161
1799599157,6cyclictest23638-21sh07:20:111
1799599154,6cyclictest29363-21ls12:00:001
1799599153,8cyclictest30556-21if_err_enp6s012:00:151
1799599151,10cyclictest9877-21ssh11:30:351
1799599151,10cyclictest1482-21runrttasks08:49:511
1799599151,10cyclictest13588-21sh10:21:341
1799599150,9cyclictest4473-21sed11:45:241
1799599150,10cyclictest22756-21ssh11:02:271
1799599150,10cyclictest22756-21ssh11:02:271
17990991511,3cyclictest8909-21needreboot07:55:160
17990991511,3cyclictest24263-21sh09:35:010
1799099150,6cyclictest10791-21/usr/sbin/munin10:20:160
1799099150,12cyclictest780-21runrttasks08:38:050
1462299150,9tDemoTimingTask23208-21taskset10:09:565
1918829140,8tAtEmLog_024041-21taskset12:15:005
1800899146,7cyclictest17986-21cyclictest12:05:124
1800899145,7cyclictest9389-21seq11:13:084
1800899143,8cyclictest16069-21ntp_kernel_pll_10:05:194
1800899141,9cyclictest10409-21runrttasks11:49:324
1800899141,8cyclictest2839650python308:35:234
1800899141,10cyclictest19985-21/usr/sbin/munin09:50:184
18008991410,3cyclictest5009-21cpuspeed_turbos10:35:114
1800899140,10cyclictest562-21ssh09:21:124
1800899140,10cyclictest5336-21ssh09:41:284
1800899140,10cyclictest28979-21ssh11:41:204
1800899140,10cyclictest26987-21sh09:35:334
1800899140,10cyclictest20754-21basename11:55:124
1800899140,10cyclictest2059-21sh11:26:394
1800899140,10cyclictest20555-21cmp07:15:004
1800899140,10cyclictest14059-21/usr/sbin/munin10:40:194
1800899140,10cyclictest14059-21/usr/sbin/munin10:40:194
1800499144,6cyclictest32758-21cat08:45:173
1800499143,6cyclictest7228-21sensors10:00:203
1800499142,9cyclictest25719-21rm09:17:303
1800499141,9cyclictest780-21runrttasks08:56:253
1800499141,9cyclictest3063-21df_inode11:45:143
1800499141,9cyclictest19238-21ssh11:35:503
1800499141,9cyclictest10282-21/usr/sbin/munin08:00:113
18004991411,2cyclictest695-21rs:main3
18004991411,2cyclictest28353-21cpuspeed_turbos10:30:113
1800499141,10cyclictest16-1pr/legacy07:12:363
18004991410,3cyclictest9782-21runintdemo5min07:58:173
1800499140,11cyclictest29253-21ssh11:05:383
1800499140,11cyclictest2384-21ssh12:02:353
1800499140,10cyclictest9893-21/usr/sbin/munin12:25:223
1800499140,10cyclictest9550-21sh09:26:053
1800499140,10cyclictest850-21ssh09:21:243
1800499140,10cyclictest7061-21ssh10:35:393
1800499140,10cyclictest6938-21rm12:23:173
1800499140,10cyclictest4385-21sh10:16:293
1800499140,10cyclictest32566-21ssh09:56:283
1800499140,10cyclictest28776-21sh11:41:113
1800499140,10cyclictest28573-21/usr/sbin/munin08:35:243
1800499140,10cyclictest28229-21apt-key07:30:003
1800499140,10cyclictest26170-21chrt08:30:513
1800499140,10cyclictest25366-21sh09:52:463
1800499140,10cyclictest2310-21rm09:40:133
1800499140,10cyclictest22552-21sh12:14:113
1800499140,10cyclictest22526-21sh11:02:173
1800499140,10cyclictest22526-21sh11:02:163
1800499140,10cyclictest22224-21sh10:26:173
1800499140,10cyclictest21011-21sh12:30:333
1800499140,10cyclictest20874-21ssh10:43:483
1800499140,10cyclictest20874-21ssh10:43:473
1800499140,10cyclictest20618-21ssh09:32:293
1800499140,10cyclictest17796-21sh10:06:073
1800499140,10cyclictest17205-21sh11:17:163
1800499140,10cyclictest16945-21taskset08:13:543
1800499140,10cyclictest15472-21sh09:11:483
1800499140,10cyclictest15472-21sh09:11:473
1800499140,10cyclictest14517-21runintdemo5min08:08:243
1800499140,10cyclictest13727-21sh10:21:403
1800499140,10cyclictest11179-21cat09:10:003
1800499140,10cyclictest10120-21sh11:30:473
1799999143,7cyclictest7194-21users07:50:242
1799999143,6cyclictest4172-21cut08:55:102
1799999143,6cyclictest31318-21gltestperf07:35:132
1799999143,6cyclictest27334-21users07:25:252
1799999143,6cyclictest11670-21/usr/sbin/munin09:10:122
1799999143,6cyclictest11670-21/usr/sbin/munin09:10:112
1799999142,8cyclictest9300-21diskstats09:05:142
1799999142,8cyclictest23391-21basename07:20:102
1799599142,8cyclictest22083-21atemtest08:25:111
1799599141,9cyclictest5586-21diskmemload12:22:201
1799599141,9cyclictest5552-21/usr/sbin/munin07:50:191
1799599141,9cyclictest21473-21sh09:50:191
1799599141,9cyclictest10033-21sh12:06:401
1799599140,9cyclictest29896-21ssh09:20:111
1799599140,10cyclictest7622-21missed_timers09:25:151
1799599140,10cyclictest6968-21ssh10:35:351
1799599140,10cyclictest6490-21/usr/sbin/munin10:00:141
1799599140,10cyclictest354-21rm12:37:301
1799599140,10cyclictest32176-21/usr/sbin/munin10:50:111
1799599140,10cyclictest32176-21/usr/sbin/munin10:50:101
1799599140,10cyclictest31839-21ssh11:07:271
1799599140,10cyclictest24887-21ssh09:16:581
1799599140,10cyclictest24133-21ssh12:15:051
1799599140,10cyclictest23682-21ssh12:14:581
1799599140,10cyclictest20911-21/usr/sbin/munin07:15:141
1799599140,10cyclictest20911-21/usr/sbin/munin07:15:141
1799599140,10cyclictest20247-21sh09:32:141
1799599140,10cyclictest19726-21apt-get08:20:121
1799599140,10cyclictest19064-21chrt08:16:171
1799599140,10cyclictest18856-21/usr/sbin/munin12:30:191
1799599140,10cyclictest16801-21sh09:48:091
1799599140,10cyclictest14870-21/usr/sbin/munin10:05:171
1799599140,10cyclictest13871-21ssh11:15:201
1799599140,10cyclictest13844-21taskset09:10:401
1799599140,10cyclictest13844-21taskset09:10:391
1799599140,10cyclictest11898-21ssh11:14:541
1799599140,10cyclictest11770-21cat08:00:241
1799599140,10cyclictest11638-21ssh11:50:111
1799099141,9cyclictest10297-21timerandwakeup09:05:230
1799099141,10cyclictest16-1pr/legacy08:18:320
1799099140,9cyclictest7448-21cat09:00:170
1799099140,7cyclictest31691-21ssh12:36:430
1799099140,12cyclictest2175-21sed07:40:220
1799099140,10cyclictest780-21runrttasks08:42:500
1799099140,10cyclictest20717-21apt-config07:15:010
1799099140,10cyclictest20717-21apt-config07:15:000
1515799144,7tDemoTimingTask20595-21chrt11:55:105
853429130,5tAtEmLog_010645-21taskset09:06:075
615699130,3tDemoTimingTask6233-21chrt08:59:475
1800899135,6cyclictest711-21gdbus07:15:024
1800899135,6cyclictest711-21gdbus07:15:014
1800899133,7cyclictest17755-21kworker/u24:3+nfsiod10:45:224
1800899132,7cyclictest16830-21kworker/u24:0+nfsiod10:50:024
1800899132,7cyclictest16830-21kworker/u24:0+nfsiod10:50:014
1800899131,9cyclictest7105-21fschecks_time09:00:154
1800899131,9cyclictest30912-21runrttasks12:36:114
1800899130,9cyclictest9942-21aten2_r5power_c12:25:124
1800899130,9cyclictest780-21runrttasks09:05:014
1800899130,9cyclictest7618-21/usr/sbin/munin11:30:174
1800899130,9cyclictest716-21snmpd11:16:164
1800899130,9cyclictest667-21python308:45:204
1800899130,9cyclictest6407-21ssh09:25:034
1800899130,9cyclictest567-21sed07:40:004
1800899130,9cyclictest3505-21chrt08:51:034
1800899130,9cyclictest3200-21runrttasks07:45:094
1800899130,9cyclictest29504-21taskset08:40:064
1800899130,9cyclictest28349-21/usr/sbin/munin07:30:164
1800899130,9cyclictest27916-21taskset10:30:054
1800899130,9cyclictest26685-21sh12:15:414
1800899130,9cyclictest25695-21/usr/sbin/munin07:25:174
1800899130,9cyclictest25546-21grep08:30:174
1800899130,9cyclictest25440-21ssh10:10:204
1800899130,9cyclictest25168-21runintdemo5min07:22:454
1800899130,9cyclictest2395-21ssh12:02:354
1800899130,9cyclictest23274-21sh09:15:504
1800899130,9cyclictest22074-21/usr/sbin/munin08:25:244
1800899130,9cyclictest21678-21ssh11:20:104
1800899130,9cyclictest20867-21ssh12:30:254
1800899130,9cyclictest19723-21/usr/sbin/munin08:20:184
1800899130,9cyclictest18775-21sh10:25:014
1800899130,9cyclictest18083-21latency_hist07:10:004
1800899130,9cyclictest16505-21ssh11:35:044
1800899130,9cyclictest16026-21sh12:10:154
1800899130,9cyclictest15530-21ssh09:30:034
1800899130,9cyclictest14985-21/usr/sbin/munin08:10:134
1800899130,9cyclictest13691-21sh11:50:294
1800899130,9cyclictest10933-21sh10:02:394
1800899130,7cyclictest87439grep10:15:114
1800899130,11cyclictest997-21cut12:20:124
1800899130,11cyclictest12864-21cpuspeed_turbos08:05:134
1800899130,10cyclictest9654-21runrttasks07:56:424
1800899130,10cyclictest5959-21runrttasks08:56:444
1800899130,10cyclictest29101-21/usr/sbin/munin09:55:194
1800899130,10cyclictest14874-21ssh09:46:474
1800899130,10cyclictest12323-21taskset08:04:584
1800499135,6cyclictest5986-21cut07:50:143
1800499132,8cyclictest24537-21python307:20:183
1800499131,9cyclictest5796-21sh11:10:363
1800499130,9cyclictest8826-21/usr/sbin/munin10:55:183
1800499130,9cyclictest8826-21/usr/sbin/munin10:55:183
1800499130,9cyclictest3279-21/usr/sbin/munin07:45:123
1800499130,9cyclictest30694-21runrttasks07:35:053
1800499130,9cyclictest27580-21runintdemo5min07:27:533
1800499130,9cyclictest26599-21ssh12:15:383
1800499130,9cyclictest23674-21ssh10:10:023
1800499130,9cyclictest21664-21/usr/sbin/munin11:20:233
1800499130,10cyclictest7865-21diskmemload12:05:233
1800499130,10cyclictest326-21systemd-journal08:20:523
1800499130,10cyclictest31201-21taskset08:40:533
1800499130,10cyclictest11776-21sh09:45:163
1799999132,6cyclictest15104-21cpu08:10:122
1799999130,9cyclictest8826-21/usr/sbin/munin10:55:132
1799999130,9cyclictest8826-21/usr/sbin/munin10:55:122
1799999130,9cyclictest780-21runrttasks09:00:132
1799999130,9cyclictest29510-21/usr/sbin/munin08:40:112
1799999130,9cyclictest19894-21cpuspeed08:20:142
1799999130,9cyclictest18245-21runrttasks07:10:022
1799599133,8cyclictest4881-21/usr/sbin/munin08:55:151
1799599131,7cyclictest22510-21ssh11:20:151
1799599130,9cyclictest9527-21grep07:55:221
1799599130,9cyclictest9155-21cpuspeed_turbos09:05:131
1799599130,9cyclictest4419-21sendmail_mailtr07:45:211
1799599130,9cyclictest32423-21apt-get10:15:011
1799599130,9cyclictest31348-21runrttasks08:42:531
1799599130,9cyclictest30698-21chrt07:35:071
1799599130,9cyclictest29101-21/usr/sbin/munin09:55:131
1799599130,9cyclictest2895-21cron07:45:001
1799599130,9cyclictest28349-21/usr/sbin/munin07:30:121
1799599130,9cyclictest25864-21sh10:45:531
1799599130,9cyclictest25695-21/usr/sbin/munin07:25:131
1799599130,9cyclictest1801-21runrttasks08:50:091
1799599130,9cyclictest1769-21ssh09:40:061
1799599130,9cyclictest14013-21sh10:40:091
1799599130,9cyclictest14013-21sh10:40:081
1799599130,9cyclictest12635-21/usr/sbin/munin08:05:151
1799599130,9cyclictest12273-21sh12:25:411
1799599130,9cyclictest11404-21ssh10:55:481
1799599130,9cyclictest11404-21ssh10:55:471
1799599130,10cyclictest7269-21/usr/sbin/munin09:00:171
1799599130,10cyclictest32168-21ssh11:25:191
1799599130,10cyclictest31181-21ssh10:31:111
1799599130,10cyclictest26555-21latency_hist08:35:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional