You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-18 - 09:59
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Wed Mar 18, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
30839391000,0EcMasterDemoSyn0-21swapper/021:27:370
277439930,0EcMasterDemoSyn278429tAtEmLog_021:47:545
1504739840,0EcMasterDemoSyn1505729tAtEmLog_020:36:555
2095639830,0EcMasterDemoSyn2096629tAtEmLog_022:33:345
553339820,0EcMasterDemoSyn554329tAtEmLog_020:16:385
518039820,0EcMasterDemoSyn519029tAtEmLog_000:30:105
2687239820,0EcMasterDemoSyn2688329tAtEmLog_021:02:175
2552339820,0EcMasterDemoSyn2553329tAtEmLog_022:53:515
222839820,0EcMasterDemoSyn223829tAtEmLog_022:58:555
2141239820,0EcMasterDemoSyn2142229tAtEmLog_019:41:095
1903439820,0EcMasterDemoSyn1904429tAtEmLog_019:36:045
1268839820,0EcMasterDemoSyn1269829tAtEmLog_020:31:525
747239810,0EcMasterDemoSyn748229tAtEmLog_022:08:125
2456639810,0EcMasterDemoSyn2457629tAtEmLog_023:29:195
1667939810,0EcMasterDemoSyn1668929tAtEmLog_019:31:015
3083939280,0EcMasterDemoSyn30845-21ps21:27:373
77242240,0sleep50-21swapper/521:15:105
5208992113,6cyclictest6413-21strings00:30:201
5213991915,3cyclictest30124-21head20:00:172
748399180,15tDemoTimingTask14375-21taskset22:11:385
541129180,8tAtEmLog_08631-21chrt23:55:335
520199180,10cyclictest28717-21sh22:37:390
958799170,10tDemoTimingTask10188-21taskset19:20:015
792799170,7tDemoTimingTask8082-21chrt20:23:305
522099173,10cyclictest8147-21sh22:08:393
522099170,9cyclictest2351-21ssh21:12:073
521399175,9cyclictest755-21postgres19:16:072
520199174,9cyclictest9374-21sh23:02:320
520199170,9cyclictest780-21runrttasks20:44:350
520199170,9cyclictest780-21runrttasks19:41:030
520199170,9cyclictest28752-21sh21:44:450
520199170,9cyclictest12842-21sh00:15:540
520199170,9cyclictest11764-21sh22:45:310
520199170,11cyclictest174-1kworker/0:1H+kblockd23:49:540
480399170,14tDemoTimingTask5086-21chrt19:09:105
3087499170,7tDemoTimingTask32727-21chrt20:05:205
3087499170,7tDemoTimingTask30931-21chrt20:01:495
2056639170,0EcMasterDemoSyn0-21swapper/523:09:035
1490939170,0EcMasterDemoSyn0-21swapper/500:35:165
1143639170,0EcMasterDemoSyn0-21swapper/523:03:585
792799160,7tDemoTimingTask10303-21chrt20:26:365
792799160,7tDemoTimingTask10303-21chrt20:26:365
522699160,9cyclictest26745-21/usr/sbin/munin19:55:234
522099161,9cyclictest29669-21taskset21:08:443
522099160,9cyclictest6181-21runrttasks23:36:283
522099160,12cyclictest16-1pr/legacy00:30:093
521399160,10cyclictest19452-21ssh00:01:452
520899160,9cyclictest20100-21diskmemload00:38:141
520199161,9cyclictest27799-21sh00:24:520
520199160,9cyclictest780-21runrttasks20:45:560
2969699160,9tDemoTimingTask30853-21chrt23:14:555
2613699160,9tDemoTimingTask26731-21taskset19:55:015
1196829160,9tAtEmLog_012294-21taskset19:24:545
522699158,5cyclictest8694-21grep23:20:164
522699152,9cyclictest20292-21ssh23:08:524
522699150,9cyclictest7272-21ssh22:08:044
522699150,9cyclictest26961-21sh22:36:234
522099152,9cyclictest780-21runrttasks20:04:343
522099151,9cyclictest705-21runrttasks23:34:013
522099151,10cyclictest16363-21timerandwakeup19:30:223
522099150,13cyclictest25536-21latency_hist23:30:003
521399152,9cyclictest13790-21fschecks_time20:35:152
521399150,9cyclictest8333-21ssh22:26:022
521399150,9cyclictest16814-21ssh22:30:382
521399150,11cyclictest5243-21/usr/sbin/munin00:30:262
521399150,11cyclictest21533-21ssh21:22:292
521399150,10cyclictest6595-21ssh21:50:082
520899154,8cyclictest711-21gdbus00:10:201
520899154,6cyclictest20872-21grep21:40:121
520899153,9cyclictest4337-21vmstat21:30:261
520899153,8cyclictest648-21dbus-daemon23:35:201
520899153,8cyclictest3439-21unixbench_singl22:05:251
5208991511,3cyclictest19372-21sh19:40:001
520899151,10cyclictest13077-21sh21:17:561
520899150,9cyclictest3245-21sh23:17:031
520899150,9cyclictest32140-21ssh00:26:311
520199158,6cyclictest2297-21grep00:10:170
520199156,7cyclictest30211-21ssh23:50:120
520199155,8cyclictest13488-21/usr/sbin/munin20:35:140
520199154,10cyclictest4695-21date00:29:590
520199153,5cyclictest12275-21sed22:10:250
520199151,8cyclictest9934-21latency_hist19:19:590
520199151,10cyclictest3835-21diskmemload21:48:390
520199151,10cyclictest23339-21sh21:23:430
520199151,10cyclictest19945-21sh00:38:070
520199150,9cyclictest6462-21diskmemload21:50:030
520199150,9cyclictest29518-21sh00:07:310
520199150,8cyclictest21197-21sh22:15:190
520199150,13cyclictest6839-21rm21:14:590
520199150,10cyclictest21338-21ssh23:09:340
520199150,10cyclictest20111-21idleruntime-cro21:39:590
520199150,10cyclictest10576-21ssh23:39:320
520199150,10cyclictest10331-21ssh21:16:030
716339140,3EcMasterDemoSyn651irq_work/522:43:425
716339140,3EcMasterDemoSyn651irq_work/522:43:425
522699148,4cyclictest16-1pr/legacy20:11:334
522699144,6cyclictest13435-21sed23:40:234
522699142,8cyclictest780-21runrttasks19:30:234
522699141,9cyclictest22996-21sh22:52:034
522699141,9cyclictest22354-21sshd20:54:324
522699141,10cyclictest30763-21users20:00:244
522699141,10cyclictest30386-21/usr/sbin/munin21:10:194
522699140,9cyclictest20141-21df22:15:124
522699140,9cyclictest18267-21sh00:00:554
522699140,11cyclictest8679-21sh21:50:264
522699140,10cyclictest9890-21sh22:27:064
522699140,10cyclictest9695-21wget22:45:104
522699140,10cyclictest9308-21sh21:33:494
522699140,10cyclictest780-21runrttasks00:16:354
522699140,10cyclictest4113-21ssh22:24:264
522699140,10cyclictest3567-21sh22:59:494
522699140,10cyclictest32132-21sed20:05:154
522699140,10cyclictest28317-21ssh21:25:524
522699140,10cyclictest27499-21ssh00:06:044
522699140,10cyclictest24250-21ssh21:41:364
522699140,10cyclictest13977-21ssh23:59:224
522699140,10cyclictest12833-21runrttasks23:04:564
522699140,10cyclictest11836-21sh21:17:054
522699140,10cyclictest11794-21grep20:30:184
522099141,9cyclictest9625-21sh21:15:333
522099141,9cyclictest716-21snmpd21:23:453
522099141,9cyclictest32398-21sh00:26:433
522099141,9cyclictest313-21ssh22:40:043
522099141,9cyclictest313-21ssh22:40:043
522099141,9cyclictest30770-21sh23:14:513
522099141,9cyclictest30146-21runrttasks22:55:433
522099141,9cyclictest25809-21sh21:42:413
522099141,9cyclictest1380-21sh23:15:393
522099141,10cyclictest13915-21ssh21:35:433
522099140,9cyclictest1163-21/usr/sbin/munin00:10:243
522099140,10cyclictest9364-21taskset22:26:453
522099140,10cyclictest8997-21chrt23:55:493
522099140,10cyclictest7899-21sh23:20:063
522099140,10cyclictest780-21runrttasks22:38:103
522099140,10cyclictest780-21runrttasks00:18:223
522099140,10cyclictest7532-21munin-run19:15:003
522099140,10cyclictest716-21snmpd21:53:213
522099140,10cyclictest716-21snmpd20:23:073
522099140,10cyclictest32084-21sh22:21:203
522099140,10cyclictest30441-21ssh21:45:163
522099140,10cyclictest28170-21timerandwakeup19:55:233
522099140,10cyclictest2636-21sh23:52:433
522099140,10cyclictest24599-21sh22:00:013
522099140,10cyclictest24400-21ssh00:05:023
522099140,10cyclictest24109-21sh00:22:143
522099140,10cyclictest23497-21ssh23:45:553
522099140,10cyclictest22248-21cpuspeed_turbos19:45:113
522099140,10cyclictest20899-21sh21:57:393
522099140,10cyclictest20355-21runrttasks20:50:113
522099140,10cyclictest19735-21/usr/sbin/munin22:15:163
522099140,10cyclictest19349-21seq19:39:523
522099140,10cyclictest18450-21rm23:07:343
522099140,10cyclictest15121-21ssh22:12:093
522099140,10cyclictest14968-40mandb00:00:023
522099140,10cyclictest12896-21sh22:46:183
522099140,10cyclictest11582-21hddtemp_smartct20:30:163
522099140,10cyclictest10857-21ssh21:34:543
521399144,8cyclictest18779-21cut22:50:102
521399144,5cyclictest27317-21timerandwakeup21:25:212
521399143,8cyclictest755-21postgres22:55:152
521399143,8cyclictest25413-21unixbench_multi22:35:232
521399143,7cyclictest15158-21kworker/u24:1+xprtiod22:14:552
521399142,8cyclictest1426-21atemtest20:10:122
521399141,9cyclictest516-21seq23:15:212
521399141,9cyclictest26727-21taskset21:00:282
521399141,9cyclictest23341-21irqstats23:10:152
521399141,9cyclictest21666-21diskmemload00:20:302
521399141,10cyclictest21222-21ssh23:26:582
521399141,10cyclictest14311-21runrttasks19:25:562
521399140,11cyclictest8206-21apache221:55:532
521399140,10cyclictest9998-21rm21:15:492
521399140,10cyclictest8559-21/usr/sbin/munin20:25:212
521399140,10cyclictest8559-21/usr/sbin/munin20:25:202
521399140,10cyclictest780-21runrttasks19:55:192
521399140,10cyclictest7145-21runrttasks19:10:352
521399140,10cyclictest6953-21sh23:37:012
521399140,10cyclictest6863-21ssh22:07:472
521399140,10cyclictest6840-21ssh23:55:132
521399140,10cyclictest5908-21ssh22:42:492
521399140,10cyclictest5908-21ssh22:42:482
521399140,10cyclictest5136-21sh21:30:592
521399140,10cyclictest4601-21ls23:00:142
521399140,10cyclictest3583-21ssh00:29:172
521399140,10cyclictest32343-21sh00:09:322
521399140,10cyclictest32027-21ssh23:50:352
521399140,10cyclictest30810-21diskstats21:10:132
521399140,10cyclictest29547-21ssh23:31:292
521399140,10cyclictest25878-21ssh21:42:452
521399140,10cyclictest25746-21find19:50:242
521399140,10cyclictest24873-21/usr/sbin/munin22:00:202
521399140,10cyclictest24509-21diskmemload23:46:382
521399140,10cyclictest22498-21latency_hist20:55:012
521399140,10cyclictest22441-21sh22:15:552
521399140,10cyclictest22042-21/usr/sbin/munin19:45:132
521399140,10cyclictest19549-21grep20:45:222
521399140,10cyclictest16605-21taskset23:06:162
521399140,10cyclictest15684-21sh23:41:452
521399140,10cyclictest15488-21ssh21:36:502
521399140,10cyclictest1338-21ssh21:46:552
521399140,10cyclictest12813-21ssh00:15:522
521399140,10cyclictest1266-21ssh22:22:272
521399140,10cyclictest11571-21taskset22:45:242
521399140,10cyclictest10197-21sh23:20:312
520899143,8cyclictest12175-21smartctl22:10:231
520899142,9cyclictest4637-21load20:15:181
520899141,9cyclictest5473-21/usr/sbin/munin19:10:181
520899141,9cyclictest27763-21sh21:25:281
520899141,9cyclictest26868-21sh23:48:181
520899141,9cyclictest23005-21ssh22:34:571
520899141,9cyclictest22657-21ssh23:28:001
520899141,9cyclictest17522-21runrttasks20:42:471
520899141,9cyclictest11094-21sh22:45:191
520899141,9cyclictest10070-21ssh23:20:261
520899141,10cyclictest9538-21runrttasks19:15:271
520899141,10cyclictest28104-21fschecks_count21:05:151
520899140,9cyclictest29589-21ssh23:31:301
520899140,9cyclictest19457-21ssh22:50:141
520899140,10cyclictest9452-21ssh21:50:581
520899140,10cyclictest780-21runrttasks21:00:251
520899140,10cyclictest6151-21/usr/sbin/munin20:20:171
520899140,10cyclictest4314-21sh23:00:091
520899140,10cyclictest392-21sh21:46:171
520899140,10cyclictest32498-21sh23:50:561
520899140,10cyclictest30711-21users22:20:221
520899140,10cyclictest30134-21sh21:10:001
520899140,10cyclictest28357-21/usr/sbin/munin22:55:131
520899140,10cyclictest27222-21ssh00:05:531
520899140,10cyclictest26382-21ssh22:00:241
520899140,10cyclictest25430-21ssh23:11:081
520899140,10cyclictest2422-21sed22:40:241
520899140,10cyclictest2422-21sed22:40:231
520899140,10cyclictest23982-21diskstats22:35:131
520899140,10cyclictest23331-21ssh22:16:331
520899140,10cyclictest23006-21grep19:45:161
520899140,10cyclictest20691-21sh00:02:381
520899140,10cyclictest20229-21fschecks_time00:20:161
520899140,10cyclictest18601-21ssh23:07:391
520899140,10cyclictest17189-21sh23:42:501
520899140,10cyclictest16811-21ssh21:37:461
520899140,10cyclictest16566-21sh21:20:091
520899140,10cyclictest16193-21/usr/sbin/munin21:55:141
520899140,10cyclictest12103-21ssh23:58:011
520199145,7cyclictest17139-21/usr/sbin/munin00:00:230
520199143,8cyclictest6269-21cut20:20:110
520199143,8cyclictest2668-21tr21:30:130
520199143,8cyclictest20950-21gltestperf20:50:150
520199141,10cyclictest30054-21diskmemload22:55:400
520199140,9cyclictest27364-21sh23:12:290
520199140,7cyclictest29916-21latency_hist21:10:000
520199140,7cyclictest29312-21grep22:20:130
520199140,7cyclictest17110-21aten2_r5power_e23:25:110
520199140,6cyclictest5186-21ps00:30:110
520199140,12cyclictest26381-21grep23:30:120
520199140,12cyclictest20701-21sh21:57:310
520199140,12cyclictest16677-21sed23:24:590
520199140,11cyclictest32581-21grep23:15:180
520199140,10cyclictest469-21ssh22:40:100
520199140,10cyclictest469-21ssh22:40:090
520199140,10cyclictest23001-21needreboot19:45:160
520199140,10cyclictest21157-21ssh22:50:430
520199140,10cyclictest17607-21tr19:35:130
520199140,10cyclictest14527-21sh23:40:570
520199140,10cyclictest1376-21rm22:05:050
522699139,3cyclictest1487-21cpuspeed_turbos00:10:114
522699135,6cyclictest31762-21cpuspeed23:15:134
522699135,6cyclictest24395-21apt19:50:104
522699135,6cyclictest18042-21aten2_r5power_e20:45:124
522699133,7cyclictest716-21snmpd20:38:394
522699133,7cyclictest23934-21smartctl23:10:194
522699133,7cyclictest19035-21tail19:41:084
522699133,5cyclictest30187-21expr23:50:114
522699130,9cyclictest8559-21/usr/sbin/munin20:25:134
522699130,9cyclictest8559-21/usr/sbin/munin20:25:134
522699130,9cyclictest780-21runrttasks22:42:394
522699130,9cyclictest780-21runrttasks22:42:394
522699130,9cyclictest780-21runrttasks19:15:354
522699130,9cyclictest7348-21sh00:30:324
522699130,9cyclictest6821-21hddtemp_smartct20:20:154
522699130,9cyclictest31740-21ssh21:45:294
522699130,9cyclictest26054-21/usr/sbin/munin22:00:204
522699130,9cyclictest25985-21sh23:30:064
522699130,9cyclictest23159-21diskmemload23:45:414
522699130,9cyclictest22042-21/usr/sbin/munin19:45:104
522699130,9cyclictest19972-21sh23:26:054
522699130,9cyclictest19608-21sh00:20:124
522699130,9cyclictest17319-21/usr/sbin/munin19:35:174
522699130,9cyclictest14160-21sh21:35:534
522699130,9cyclictest13794-21which19:25:204
522699130,9cyclictest13396-21ssh22:10:574
522699130,9cyclictest11935-21taskset19:20:414
522699130,10cyclictest29000-21cat21:05:234
522699130,10cyclictest28704-21ssh00:25:124
522699130,10cyclictest2647-21ssh23:35:084
522699130,10cyclictest25909-21cat21:00:184
522699130,10cyclictest23505-21sed20:55:184
522699130,10cyclictest19486-21rm22:32:324
522699130,10cyclictest17845-21rm21:55:294
522699130,10cyclictest16662-21grep21:20:124
522699130,10cyclictest14001-21ssh00:35:064
522099131,9cyclictest14102-21sh00:35:113
522099130,9cyclictest9678-21taskset19:16:393
522099130,9cyclictest780-21runrttasks23:40:043
522099130,9cyclictest7115-21chrt23:00:583
522099130,9cyclictest27448-21cut21:05:003
522099130,9cyclictest24394-21/usr/sbin/munin19:50:123
522099130,9cyclictest19692-21/usr/sbin/munin19:40:173
522099130,9cyclictest18540-21ssh22:50:043
522099130,9cyclictest17992-21/usr/sbin/munin20:45:133
522099130,9cyclictest15991-21df20:40:133
522099130,9cyclictest14337-21sh22:30:013
522099130,9cyclictest1416-21/usr/sbin/munin20:10:123
522099130,9cyclictest11900-21vmstat19:20:233
522099130,9cyclictest10377-21runrttasks20:26:583
522099130,9cyclictest10377-21runrttasks20:26:573
522099130,10cyclictest957-21chrt20:08:013
522099130,10cyclictest4528-21kernelversion20:15:173
522099130,10cyclictest14022-21/usr/sbin/munin20:35:173
522099130,10cyclictest13015-21fschecks_count19:25:153
521399130,9cyclictest780-21runrttasks19:21:452
521399130,9cyclictest6151-21/usr/sbin/munin20:20:202
521399130,9cyclictest32039-21fschecks_time20:05:152
521399130,9cyclictest19809-21aten2_r5power_v19:40:122
521399130,9cyclictest18757-21wc19:35:242
521399130,9cyclictest10913-21/usr/sbin/munin20:30:142
521399130,9cyclictest1067-21ssh00:10:062
521399130,10cyclictest4454-21/usr/sbin/munin20:15:162
521399130,10cyclictest28414-21basename21:05:172
521399130,10cyclictest23023-21cpuspeed_turbos20:55:142
521399130,10cyclictest17677-21ssh00:36:302
521399130,10cyclictest16457-21latency20:40:172
521399130,10cyclictest16213-21/usr/sbin/munin19:30:182
520899131,9cyclictest22698-21/usr/sbin/munin20:55:241
520899130,9cyclictest780-21runrttasks20:25:201
520899130,9cyclictest780-21runrttasks20:25:191
520899130,9cyclictest780-21runrttasks20:06:121
520899130,9cyclictest780-21runrttasks19:55:101
520899130,9cyclictest716-21snmpd20:45:041
520899130,9cyclictest30787-21sshd20:00:341
520899130,9cyclictest2650-21munin-node22:25:111
520899130,9cyclictest26186-21runrttasks19:51:351
520899130,9cyclictest21369-21chrt19:40:411
520899130,9cyclictest20344-21/usr/sbin/munin20:50:141
520899130,9cyclictest15716-21runrttasks19:30:141
520899130,9cyclictest1416-21/usr/sbin/munin20:10:161
520899130,9cyclictest12784-21cpuspeed19:25:121
520899130,9cyclictest12483-21tail20:30:241
520899130,9cyclictest10967-21if_enp6s019:20:151
520899130,9cyclictest10199-21/usr/sbin/munin00:15:131
520899130,10cyclictest14782-21sed20:35:241
520199135,6cyclictest7511-21ssh23:55:170
520199131,9cyclictest755-21postgres20:01:100
520199131,9cyclictest25861-21load22:00:180
520199130,9cyclictest780-21runrttasks20:15:140
520199130,9cyclictest780-21runrttasks19:25:110
520199130,9cyclictest716-21snmpd21:00:340
520199130,9cyclictest32683-21runrttasks20:05:190
520199130,9cyclictest24390-21runrttasks19:50:090
520199130,9cyclictest14385-21sh22:30:020
520199130,9cyclictest12603-21taskset20:30:500
520199130,7cyclictest5665-21awk22:25:130
520199130,7cyclictest5285-21cat19:10:000
520199130,11cyclictest780-21runrttasks19:20:110
520199130,10cyclictest7503-21runrttasks19:14:480
520199130,10cyclictest26863-21tr19:55:120
520199130,10cyclictest174-1kworker/0:1H+kblockd20:56:020
520199130,10cyclictest174-1kworker/0:1H+kblockd20:29:590
520199130,10cyclictest174-1kworker/0:1H+kblockd20:29:580
520199130,10cyclictest14952-21date19:30:000
42529130,8tAtEmLog_0600-21sleep00:14:555
2450529130,8tAtEmLog_024510-21taskset20:57:135
81229120,2tAtEmLog_03105-21chrt20:10:525
626739120,10EcMasterDemoSyn13168-21chrt23:22:395
522699128,3cyclictest5691-21cpuspeed_turbos19:10:114
522699120,9cyclictest4490-21if_enp6s020:15:164
522699120,9cyclictest15738-21aten2_r5power_v20:40:124
522099123,7cyclictest22843-21cpu20:55:133
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional