You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-09 - 15:56
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Tue Dec 09, 2025 12:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
75972970,1sleep2391rcuc/211:25:272
991239850,0EcMasterDemoSyn992029tAtEmLog_011:04:455
306939830,0EcMasterDemoSyn307929tAtEmLog_007:11:305
2724839830,0EcMasterDemoSyn2725829tAtEmLog_008:02:125
2414639830,0EcMasterDemoSyn2415629tAtEmLog_011:14:545
2015639830,0EcMasterDemoSyn2016629tAtEmLog_007:46:595
2096239820,0EcMasterDemoSyn2097229tAtEmLog_010:49:325
1912839820,0EcMasterDemoSyn1913829tAtEmLog_008:52:555
2148439810,0EcMasterDemoSyn2149429tAtEmLog_008:57:595
170902810,0sleep50-21swapper/509:28:205
1690839810,0EcMasterDemoSyn1691829tAtEmLog_011:09:505
488739710,1EcMasterDemoSyn4892-21runintdemo5min12:36:010
100539570,0EcMasterDemoSyn101629tAtEmLog_010:39:235
206332380,0sleep00-21swapper/010:24:130
1061992321,2cyclictest17317-21kworker/1:0+events11:19:571
1061992321,2cyclictest17317-21kworker/1:0+events11:19:561
53252190,0sleep40-21swapper/408:25:134
1692829190,0tAtEmLog_00-21swapper/512:25:535
2913799180,13tDemoTimingTask29150-21chrt12:05:375
234382180,1sleep423437-21diskstats07:55:144
106999181,13cyclictest16-1pr/legacy12:00:313
105699180,10cyclictest30630-21sh12:07:020
817699170,10tDemoTimingTask8180-21taskset07:21:395
489899170,10tDemoTimingTask8004-21chrt12:39:555
106999177,5cyclictest28595-21unixbench_multi09:10:253
106999177,5cyclictest19614-21cpuspeed11:35:133
106999174,9cyclictest5347-21unixbench_singl07:15:253
106999171,12cyclictest16-1pr/legacy12:05:363
106199175,9cyclictest19026-21hostname09:30:141
106199175,9cyclictest19026-21hostname09:30:131
106199170,9cyclictest2395-21ssh11:46:421
105699174,9cyclictest805-21runrttasks09:39:450
105699170,9cyclictest805-21runrttasks10:18:130
105699170,9cyclictest805-21runrttasks08:42:340
105699170,9cyclictest18854-21sh11:58:390
105699170,10cyclictest26402-21sh10:28:580
3197199160,9tDemoTimingTask32000-21taskset08:12:255
2961499160,10tDemoTimingTask29618-21taskset08:07:175
1074991611,3cyclictest713-21avahi-daemon11:55:014
106999165,8cyclictest781-21postgres10:13:433
106999160,12cyclictest20080-21grep09:30:203
106999160,12cyclictest20080-21grep09:30:193
106599162,8cyclictest14812-21cut12:20:122
106199168,6cyclictest16276-21wc09:55:001
105699166,8cyclictest2734-21sh09:43:280
105699162,10cyclictest21487-21munin-run10:50:000
105699160,9cyclictest805-21runrttasks07:23:570
105699160,8cyclictest19645-21sh12:23:410
105699160,13cyclictest805-21runrttasks10:31:000
555099150,13tDemoTimingTask9316-21taskset09:20:425
2710299150,9tDemoTimingTask27107-21taskset10:03:565
2093399150,9tDemoTimingTask22037-21taskset10:00:005
193299150,8tDemoTimingTask2471-21taskset08:20:025
1442099150,9tDemoTimingTask11961-21sleep08:44:545
107499158,5cyclictest25399-21tune2fs11:15:184
107499158,5cyclictest25399-21tune2fs11:15:184
107499154,6cyclictest13893-21fschecks_count07:35:164
107499151,10cyclictest13313-21runrttasks11:55:014
107499150,9cyclictest23401-21sh09:33:334
107499150,9cyclictest23401-21sh09:33:334
106999155,5cyclictest14990-21aten2_r5power_p08:45:143
106999154,8cyclictest1162-21wc10:09:013
106999154,5cyclictest50-21ksoftirqd/308:40:003
106999153,9cyclictest17304-21basename09:55:183
106999151,9cyclictest50-21ksoftirqd/312:33:393
106999151,7cyclictest296650latency_hist11:00:003
106999151,11cyclictest16-1pr/legacy12:15:443
106999150,11cyclictest759-21ssh10:34:073
106999150,10cyclictest9332-21chrt08:32:143
106599157,6cyclictest18871-21grep11:10:182
106599150,9cyclictest9855-21runrttasks11:04:432
106599150,9cyclictest13433-21sh12:19:092
106199151,10cyclictest805-21runrttasks10:02:221
106199151,10cyclictest27504-21latency_hist08:05:011
106199150,9cyclictest31940-21sh11:44:571
106199150,9cyclictest2272-21ssh12:35:041
106199150,8cyclictest223-21md0_raid110:32:451
105699156,7cyclictest9556-21ssh11:27:110
105699151,10cyclictest16665-21runrttasks08:46:350
105699150,7cyclictest24818-21sh12:02:510
2415629140,6tAtEmLog_030069-21taskset11:19:105
2415629140,6tAtEmLog_030069-21taskset11:19:095
2376499142,9tDemoTimingTask29707-21chrt12:30:305
1524929140,8tAtEmLog_017748-21taskset07:41:255
107499145,7cyclictest23288-21sed12:25:254
107499144,7cyclictest2039-21sshd08:18:314
107499144,2cyclictest171rcu_preempt08:00:224
107499143,8cyclictest28957-21netstat10:30:174
107499143,8cyclictest16321-21timerwakeupswit12:20:234
107499143,6cyclictest9467-21fschecks_time10:40:154
107499143,6cyclictest281-21jbd2/md0-808:09:344
107499142,7cyclictest8829-21switchtime08:30:244
107499141,9cyclictest3453-21sh11:47:494
107499141,9cyclictest11105-21sh10:15:414
1074991410,3cyclictest18596-21cpuspeed_turbos07:45:164
107499140,9cyclictest30662-21grep08:10:154
107499140,7cyclictest1318850awk07:35:014
107499140,7cyclictest1318850awk07:35:004
107499140,10cyclictest9673-21ssh11:04:304
107499140,10cyclictest8455-21ssh11:26:054
107499140,10cyclictest805-21runrttasks12:06:544
107499140,10cyclictest805-21runrttasks11:41:534
107499140,10cyclictest805-21runrttasks11:22:004
107499140,10cyclictest805-21runrttasks09:27:124
107499140,10cyclictest7324-21sh12:14:444
107499140,10cyclictest6444-21ssh10:12:504
107499140,10cyclictest4482-21chrt09:16:594
107499140,10cyclictest29787-21sh09:11:314
107499140,10cyclictest28576-21/usr/sbin/munin10:05:244
107499140,10cyclictest27942-21chrt09:36:504
107499140,10cyclictest24671-21ssh10:27:024
107499140,10cyclictest22395-21sh11:13:004
107499140,10cyclictest18724-21ssh10:47:024
107499140,10cyclictest16096-21hddtemp_smartct10:20:164
107499140,10cyclictest12031-21ssh12:17:244
106999143,8cyclictest13371-21fschecks_time11:30:143
106999142,9cyclictest805-21runrttasks11:16:013
106999142,9cyclictest805-21runrttasks11:16:013
106999141,9cyclictest9123-21sh09:48:413
106999141,9cyclictest8738-21latency_hist07:25:003
106999141,9cyclictest805-21runrttasks09:16:573
106999141,9cyclictest23173-21aten2_r5power_v07:55:123
106999141,9cyclictest15581-21sh09:54:243
106999141,10cyclictest24558-21sh10:26:523
106999140,9cyclictest28804-21diskmemload11:41:323
106999140,7cyclictest805-21runrttasks08:27:553
106999140,7cyclictest27790-21taskset08:05:013
106999140,11cyclictest25513-21wget08:00:143
106999140,11cyclictest22194-21/usr/sbin/munin07:50:233
106999140,10cyclictest9924-21basename08:35:113
106999140,10cyclictest9531-21rm11:04:213
106999140,10cyclictest6268-21ssh12:13:243
106999140,10cyclictest5762-21ssh11:25:033
106999140,10cyclictest4396-21runrttasks10:35:553
106999140,10cyclictest31855-21/usr/sbin/munin11:20:133
106999140,10cyclictest27810-21sh10:04:453
106999140,10cyclictest2496-21wget12:35:133
106999140,10cyclictest23801-21runrttasks09:02:233
106999140,10cyclictest23649-21ssh12:25:463
106999140,10cyclictest22655-21tail10:50:173
106999140,10cyclictest22619-21rm11:13:133
106999140,10cyclictest19704-21sh10:48:123
106999140,10cyclictest19029-21runrttasks08:51:423
106999140,10cyclictest17024-21unixbench-2d10:20:243
106999140,10cyclictest16022-21/usr/sbin/munin07:40:273
106999140,10cyclictest16012-21ssh11:56:003
106999140,10cyclictest1586-21sh09:42:093
106999140,10cyclictest13906-21runrttasks10:44:033
106999140,10cyclictest13172-21latency_hist07:35:013
106999140,10cyclictest13172-21latency_hist07:35:003
106999140,10cyclictest12062-21python311:05:223
106599142,9cyclictest738-21snmpd12:10:182
106599141,9cyclictest6409-21/usr/sbin/munin07:20:252
106599141,9cyclictest4427-21ssh12:35:372
106599141,9cyclictest4384-21ssh09:16:512
106599141,9cyclictest16649-21/usr/sbin/munin09:55:142
106599141,9cyclictest13405-21sh11:55:062
106599141,10cyclictest9523-21kernelversion07:25:192
106599141,10cyclictest2981-21/usr/sbin/munin10:35:202
106599141,10cyclictest2344-21rm11:21:372
106599140,10cyclictest9397-21ssh09:20:482
106599140,10cyclictest805-21runrttasks09:42:522
106599140,10cyclictest5983-21/usr/sbin/munin09:45:232
106599140,10cyclictest5815-21sendmail07:20:012
106599140,10cyclictest334-21systemd-journal09:15:012
106599140,10cyclictest30428-21sh10:31:052
106599140,10cyclictest29265-21ssh11:18:172
106599140,10cyclictest29265-21ssh11:18:162
106599140,10cyclictest26963-21sh09:35:392
106599140,10cyclictest25338-21ssh10:51:592
106599140,10cyclictest24054-21rm12:26:112
106599140,10cyclictest23559-21sh12:01:332
106599140,10cyclictest21695-21ssh11:35:482
106599140,10cyclictest20455-21ssh10:24:032
106599140,10cyclictest19490-21latency_hist08:55:002
106599140,10cyclictest15637-21cpuspeed_turbos10:45:142
106599140,10cyclictest15207-21runrttasks07:36:342
106599140,10cyclictest13900-21ssh10:44:022
106599140,10cyclictest1325-21/usr/sbin/munin07:10:192
106599140,10cyclictest13151-21ssh09:51:092
106599140,10cyclictest10172-21ssh11:52:062
106599140,10cyclictest10039-21sh10:15:182
106199146,6cyclictest2793-21sed12:10:211
106199142,9cyclictest781-21postgres12:05:471
106199141,9cyclictest9193-21diskmemload11:26:531
106199141,9cyclictest4880-21taskset08:25:041
106199141,9cyclictest17690-21ntp_kernel_pll_09:55:201
106199141,9cyclictest16022-21/usr/sbin/munin07:40:161
106199141,9cyclictest14229-21hddtemp_smartct11:55:151
106199141,10cyclictest16-1pr/legacy10:49:321
106199140,9cyclictest7905-21sh12:15:021
106199140,9cyclictest3640-21latency_hist07:15:001
106199140,9cyclictest30570-21ssh10:05:421
106199140,9cyclictest16524-21ssh12:20:241
106199140,9cyclictest15071-21diskmemload09:25:501
106199140,8cyclictest15028-21ssh11:30:501
106199140,10cyclictest8783-21ssh11:03:341
106199140,10cyclictest7443-21/usr/sbin/munin09:20:231
106199140,10cyclictest6394-21test07:20:011
106199140,10cyclictest4872-21ssh09:17:271
106199140,10cyclictest4529-21runrttasks10:36:061
106199140,10cyclictest3786-21ssh11:23:241
106199140,10cyclictest3569-21open_files08:20:211
106199140,10cyclictest32169-21sendmail_mailqu09:40:231
106199140,10cyclictest30515-21df_inode08:10:141
106199140,10cyclictest30374-21ssh09:12:051
106199140,10cyclictest25039-21hddtemp_smartct09:05:261
106199140,10cyclictest25014-21runrttasks07:58:361
106199140,10cyclictest24640-21ssh12:02:411
106199140,10cyclictest22820-21kernelversion10:50:191
106199140,10cyclictest22403-21fschecks_count09:00:131
106199140,10cyclictest21915-21/usr/sbin/munin10:25:221
106199140,10cyclictest21459-21ssh11:35:351
106199140,10cyclictest21311-21ssh12:25:041
106199140,10cyclictest20881-21sh11:11:361
106199140,10cyclictest16718-21sensors_fan10:20:211
106199140,10cyclictest16662-21chrt08:46:331
106199140,10cyclictest15196-21chrt07:36:261
106199140,10cyclictest14760-21ssh10:19:521
106199140,10cyclictest11803-21ssh10:41:421
105699146,6cyclictest29290-21/usr/sbin/munin10:05:170
105699146,6cyclictest27898-21cat09:10:180
105699146,6cyclictest23137-21ntp_offset10:50:210
105699145,7cyclictest4051-21ssh12:10:350
105699145,7cyclictest16551-21/usr/sbin/munin09:55:130
105699144,8cyclictest32669-21apt11:45:110
105699143,8cyclictest27730-21vmstat11:40:250
105699143,8cyclictest21812-21open_inodes07:50:170
105699142,9cyclictest781-21postgres07:29:370
105699141,7cyclictest29855-21latency_hist08:10:000
1056991410,3cyclictest18520-21cron09:30:000
105699140,7cyclictest9477-21sh09:20:540
105699140,7cyclictest5201-21sh10:36:530
105699140,7cyclictest28762-21memory12:30:200
105699140,7cyclictest24401-21ssh10:00:390
105699140,7cyclictest20894-21ssh09:30:320
105699140,7cyclictest20894-21ssh09:30:310
105699140,7cyclictest12592-21ssh11:30:030
105699140,7cyclictest11214-21fschecks_time09:50:140
105699140,7cyclictest10866-21ssh11:52:460
105699140,6cyclictest17939-21gltestperf08:50:160
105699140,12cyclictest4647-21sh09:45:060
105699140,12cyclictest3869-21cat10:10:260
105699140,12cyclictest2961-21cat10:59:590
105699140,10cyclictest805-21runrttasks09:09:470
105699140,10cyclictest5596-21ssh11:00:380
105699140,10cyclictest2690-21sh11:22:060
105699140,10cyclictest25583-21ssh11:15:190
105699140,10cyclictest25583-21ssh11:15:180
105699140,10cyclictest23780-21chrt09:02:040
105699140,10cyclictest20711-21processes11:35:200
105699140,10cyclictest14846-21sh11:07:410
105699140,10cyclictest146-1kworker/0:1H+kblockd11:11:510
105699140,10cyclictest11995-21sh12:17:220
105699140,10cyclictest10714-21ssh10:40:260
575599130,11tDemoTimingTask5809-21taskset11:25:065
549229130,11tAtEmLog_05546-21taskset07:16:565
414029130,2tAtEmLog_06781-21chrt12:14:155
107499135,6cyclictest22005-21aten2_r5power_c10:50:134
107499135,6cyclictest21144-21fschecks_count07:50:124
107499130,9cyclictest9896-21/usr/sbin/munin08:35:144
107499130,9cyclictest8765-21/usr/sbin/munin07:25:154
107499130,9cyclictest6193-21gpgv07:20:024
107499130,9cyclictest3261-21runrttasks07:13:344
107499130,9cyclictest30544-21switchtime10:55:274
107499130,9cyclictest30516-21rm12:31:144
107499130,9cyclictest2872-21ssh10:35:184
107499130,9cyclictest25862-21ssh10:02:304
107499130,9cyclictest19782-21cstates11:35:124
107499130,9cyclictest19636-21/usr/sbin/munin08:55:154
107499130,9cyclictest17177-21gltestperf09:55:164
107499130,9cyclictest16736-21runrttasks08:47:344
107499130,9cyclictest15345-21chrt11:31:174
107499130,9cyclictest13307-21ssh11:06:154
107499130,9cyclictest12571-21/usr/sbin/munin08:40:124
107499130,9cyclictest10671-21/usr/sbin/munin09:50:104
107499130,10cyclictest8271-21irqstats09:20:224
107499130,10cyclictest5828-21taskset09:45:224
107499130,10cyclictest4159-21unixbench_singl08:20:274
107499130,10cyclictest3677-21/usr/sbin/munin07:15:244
107499130,10cyclictest2718-21ssh12:35:144
107499130,10cyclictest25788-21runrttasks12:03:494
107499130,10cyclictest24785-21grep09:05:254
107499130,10cyclictest22301-21expr09:00:134
107499130,10cyclictest17277-21/usr/sbin/munin08:50:144
107499130,10cyclictest16028-21/usr/sbin/munin07:40:154
107499130,10cyclictest1588-21ssh09:42:094
106999130,9cyclictest8578-21sh11:50:443
106999130,9cyclictest805-21runrttasks08:20:173
106999130,9cyclictest805-21runrttasks08:19:173
106999130,9cyclictest32411-21apt-config11:45:003
106999130,9cyclictest30158-21apt-get08:10:133
106999130,9cyclictest24906-21ssh09:35:033
106999130,9cyclictest24666-21cut09:05:243
106999130,9cyclictest19636-21/usr/sbin/munin08:55:273
106999130,9cyclictest18375-21/usr/sbin/munin07:45:213
106999130,9cyclictest14582-21ssh12:20:063
106999130,9cyclictest14393-21sort07:35:193
106999130,9cyclictest14156-21sh09:25:203
106999130,9cyclictest1404-21aten2_r5power_p07:10:133
106999130,9cyclictest10499-21taskset07:26:313
106999130,10cyclictest7417-21ssh09:20:103
106999130,10cyclictest10385-21rm10:15:233
106599135,6cyclictest704-21dbus-daemon07:32:312
106599135,6cyclictest704-21dbus-daemon07:32:302
106599134,7cyclictest20150-21tune2fs08:55:192
106599130,9cyclictest9372-21runintdemo5min08:32:392
106599130,9cyclictest805-21runrttasks08:04:592
106599130,9cyclictest6287-21timerandwakeup08:25:222
106599130,9cyclictest381-21cstates08:15:142
106599130,9cyclictest3182-21idleruntime08:20:182
106599130,9cyclictest31418-21swap08:10:242
106599130,9cyclictest29733-21gltestperf10:55:172
106599130,9cyclictest28638-21uname12:30:202
106599130,9cyclictest28580-21taskset11:41:152
106599130,9cyclictest28564-21kernelversion08:05:182
106599130,9cyclictest27601-21ssh12:05:132
106599130,9cyclictest25805-21cat09:05:342
106599130,9cyclictest22553-21cpu10:00:142
106599130,9cyclictest2230-21ssh10:10:052
106599130,9cyclictest18925-21ssh09:30:092
106599130,9cyclictest18925-21ssh09:30:082
106599130,9cyclictest15602-21idleruntime08:45:182
106599130,9cyclictest14299-21ssh11:07:142
106599130,9cyclictest13401-21grep08:40:172
106599130,9cyclictest10301-21grep08:35:142
106599130,10cyclictest30195-21timerwakeupswit10:05:252
106599130,10cyclictest2303-21runrttasks11:46:322
106599130,10cyclictest22317-21runrttasks10:25:162
106599130,10cyclictest21210-21cut07:50:142
106599130,10cyclictest16499-21fschecks_time07:40:162
106599130,10cyclictest13807-21kernelversion09:25:182
106599130,10cyclictest13704-21sed11:30:172
106199132,8cyclictest8868-21cut07:25:151
106199130,9cyclictest9899-21apt-get08:35:111
106199130,9cyclictest805-21runrttasks08:15:351
106199130,9cyclictest7771-21cpuspeed_turbos08:30:151
106199130,9cyclictest6866-21fschecks_count11:50:171
106199130,9cyclictest3677-21/usr/sbin/munin07:15:191
106199130,9cyclictest28873-21ssh10:55:021
106199130,9cyclictest27802-21/usr/sbin/munin08:05:191
106199130,9cyclictest27792-21/usr/sbin/munin12:30:151
106199130,9cyclictest24879-21ssh09:35:001
106199130,9cyclictest2391-21/usr/sbin/munin10:10:221
106199130,9cyclictest19673-21taskset08:55:161
106199130,9cyclictest18553-21switchtime08:50:241
106199130,9cyclictest18367-21runrttasks07:45:051
106199130,9cyclictest11850-21ntp_kernel_pll_11:05:201
106199130,10cyclictest7459-21ssh09:46:281
106199130,10cyclictest738-21snmpd07:30:331
106199130,10cyclictest738-21snmpd07:30:331
106199130,10cyclictest22439-21runrttasks07:51:151
105699131,9cyclictest805-21runrttasks08:03:290
105699131,9cyclictest21830-21cpuspeed_turbos12:25:150
105699131,9cyclictest1864-21cut09:15:200
105699130,9cyclictest805-21runrttasks08:18:020
105699130,9cyclictest6025-21latency_hist07:20:010
105699130,9cyclictest5401-21tune2fs08:25:130
105699130,9cyclictest3431-21latency_hist07:15:000
105699130,9cyclictest31876-21taskset08:11:210
105699130,9cyclictest24435-21timerandwakeup07:55:230
105699130,9cyclictest11108-21chrt07:30:050
105699130,9cyclictest11108-21chrt07:30:050
105699130,7cyclictest146-1kworker/0:1H+kblockd07:39:410
105699130,11cyclictest805-21runrttasks08:58:330
105699130,10cyclictest8798-21python308:30:220
105699130,10cyclictest805-21runrttasks07:40:340
105699130,10cyclictest19636-21python307:45:250
105699130,10cyclictest10655-21grep08:35:160
101629131,2tAtEmLog_01705-21sleep10:35:005
917029120,2tAtEmLog_013831-21chrt09:52:065
817529120,10tAtEmLog_010501-21taskset07:26:335
782999120,10tDemoTimingTask8622-21taskset11:50:465
3152999120,10tDemoTimingTask473-21chrt09:14:475
3152999120,10tDemoTimingTask2368-21chrt09:15:245
3075799120,10tDemoTimingTask599-21taskset07:05:545
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional