You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-02 - 10:32
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Thu Apr 02, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
14562391090,0EcMasterDemoSyn0-21swapper/423:26:274
303862970,1sleep00-21swapper/000:10:560
302432960,0sleep50-21swapper/523:35:175
9282840,0sleep30-21swapper/321:50:143
2421739830,0EcMasterDemoSyn2422729tAtEmLog_022:56:025
978439820,0EcMasterDemoSyn979429tAtEmLog_023:41:405
388139820,0EcMasterDemoSyn389129tAtEmLog_019:17:585
3260039820,0EcMasterDemoSyn3261029tAtEmLog_020:18:505
2864639820,0EcMasterDemoSyn2865629tAtEmLog_023:16:205
2551739820,0EcMasterDemoSyn2552729tAtEmLog_020:03:375
152239820,0EcMasterDemoSyn153229tAtEmLog_019:12:545
1443739820,0EcMasterDemoSyn1444729tAtEmLog_020:49:155
1097839820,0EcMasterDemoSyn1098829tAtEmLog_019:33:115
2682039810,0EcMasterDemoSyn2683029tAtEmLog_000:27:185
2483039810,0EcMasterDemoSyn2484029tAtEmLog_022:20:325
2367239810,0EcMasterDemoSyn2368229tAtEmLog_023:31:325
3260839800,0EcMasterDemoSyn3261829tAtEmLog_021:50:065
257139800,0EcMasterDemoSyn258129tAtEmLog_020:23:535
1097839450,1EcMasterDemoSyn10985-21grep19:33:114
83962270,1sleep48397-21ssh22:11:434
1952639230,1EcMasterDemoSyn19535-21wc23:11:152
3182499193,10cyclictest716-21snmpd21:19:263
494099180,7tDemoTimingTask7273-21chrt20:33:575
467529180,10tAtEmLog_04754-21chrt21:34:565
3181799186,9cyclictest716-21snmpd23:29:422
3180499186,9cyclictest13980-21sh23:08:410
3180499180,14cyclictest9469-21sh00:17:400
3180499180,13cyclictest2421-21sh22:26:110
126342180,0sleep00-21swapper/000:01:060
3180499175,10cyclictest21160-21cat21:25:230
3180499171,12cyclictest16-1pr/legacy21:14:350
3180499170,9cyclictest780-21runrttasks23:04:480
3180499170,9cyclictest780-21runrttasks20:26:430
3180499170,9cyclictest7338-21vmstat21:35:240
3180499170,9cyclictest29036-21runrttasks22:40:460
3180499170,9cyclictest26529-21sh00:27:070
3180499170,9cyclictest25991-21ssh21:45:400
3180499170,9cyclictest22916-21sh22:37:500
3180499170,9cyclictest22916-21sh22:37:500
3180499170,9cyclictest19475-21sh23:11:130
3180499170,9cyclictest10916-21sh23:25:050
3180499170,14cyclictest23748-21ssh00:07:340
1457229170,7tAtEmLog_015031-21chrt23:26:465
627299160,9tDemoTimingTask6521-21taskset19:25:015
493929160,10tAtEmLog_05038-21chrt20:29:565
3182899165,8cyclictest17922-21postgres19:45:464
3182499164,8cyclictest11488-21missed_timers21:20:173
3182499160,9cyclictest16635-21sh22:16:073
3180499160,11cyclictest31142-21sh00:30:090
3180499160,10cyclictest31458-21sh22:06:320
2877329160,9tAtEmLog_028778-21taskset22:05:195
2343339160,3EcMasterDemoSyn651irq_work/521:45:025
350899150,9tDemoTimingTask30656-21sleep00:34:555
3182899157,6cyclictest648-21dbus-daemon20:00:004
3182899154,6cyclictest5395-21aten2_r5power_e20:30:124
3182899154,6cyclictest16640-21seq00:03:544
3182899151,7cyclictest4930-21/usr/sbin/munin19:20:134
3182899150,11cyclictest16-1pr/legacy20:13:444
3182499159,2cyclictest18291-21sh19:50:003
3182499154,8cyclictest755-21postgres00:37:593
3182499151,10cyclictest3096-21ntpq19:15:183
3181799151,10cyclictest4734-21ssh21:16:282
3181799150,9cyclictest4136-21ssh00:15:052
3181799150,9cyclictest13189-21ssh00:37:502
3181799150,10cyclictest29611-21rm22:59:502
3181199154,8cyclictest728-21lldpd23:27:471
3181199151,11cyclictest16-1pr/legacy21:45:011
3181199151,10cyclictest8726-21ssh21:19:161
3181199151,10cyclictest28627-21diskmemload23:16:181
3181199151,10cyclictest20643-21open_files21:00:191
3181199150,10cyclictest6876-21sh00:15:531
3180499158,5cyclictest12471-21ssh00:37:210
3180499156,7cyclictest5162-21ssh23:57:130
3180499151,8cyclictest16-1pr/legacy22:15:270
3180499151,12cyclictest23923-21sh22:02:500
3180499150,9cyclictest14475-21/usr/sbin/munin00:20:170
3180499150,11cyclictest716-21snmpd19:37:010
3180499150,11cyclictest18137-21ssh22:53:060
3180499150,10cyclictest15421-21gltestperf20:50:140
1387299150,10tDemoTimingTask18178-21sleep00:05:005
3182899143,8cyclictest32647-21mailstats00:30:214
3182899141,9cyclictest7828-21wget20:35:134
3182899141,9cyclictest7580-21sh22:47:034
3182899141,9cyclictest2026-21apt19:15:104
3182899141,9cyclictest18069-21ssh22:53:034
3182899141,9cyclictest10153-21latency_hist21:20:014
3182899141,10cyclictest16-1pr/legacy23:46:434
3182899141,10cyclictest16-1pr/legacy20:23:534
31828991410,3cyclictest32731-21cron20:20:004
3182899140,9cyclictest20231-21gltestperf21:00:154
3182899140,8cyclictest24895-21ssh00:08:234
3182899140,10cyclictest8616-21ssh23:40:524
3182899140,10cyclictest531-21ssh22:07:364
3182899140,10cyclictest31464-21cat22:25:004
3182899140,10cyclictest28493-21sh21:30:024
3182899140,10cyclictest28305-21sh23:34:484
3182899140,10cyclictest27488-21sh00:27:454
3182899140,10cyclictest26585-21head23:15:184
3182899140,10cyclictest22610-21/usr/sbin/munin22:55:194
3182899140,10cyclictest18745-21sh23:10:424
3182899140,10cyclictest13814-21ssh21:57:064
3182899140,10cyclictest13345-21ssh22:32:314
3182899140,10cyclictest12941-21cat00:20:004
3182499146,6cyclictest9708-21tail19:30:143
3182499146,6cyclictest8319-21grep19:25:223
3182499144,5cyclictest23905-21ps21:09:333
3182499143,8cyclictest1220-21cut20:20:153
3182499142,9cyclictest326-21systemd-journal23:00:013
3182499141,9cyclictest29132-21/usr/sbin/munin23:35:123
3182499141,9cyclictest23050-21diskmemload00:07:063
3182499141,9cyclictest12934-21timerwakeupswit19:35:213
3182499141,9cyclictest11166-21ssh22:30:573
3182499140,9cyclictest24712-21ssh22:20:283
3182499140,8cyclictest17519-21aten2_r5power_c22:35:113
3182499140,8cyclictest17519-21aten2_r5power_c22:35:113
3182499140,12cyclictest32664-21ssh00:30:213
3182499140,10cyclictest9216-21sh22:48:133
3182499140,10cyclictest9149-21ssh00:17:283
3182499140,10cyclictest780-21runrttasks22:50:053
3182499140,10cyclictest7634-21ssh23:22:573
3182499140,10cyclictest7579-21rm21:35:343
3182499140,10cyclictest7274-21ssh23:58:433
3182499140,10cyclictest6029-21/usr/sbin/munin23:40:123
3182499140,10cyclictest28816-21ssh23:52:213
3182499140,10cyclictest28318-21/usr/sbin/munin20:10:223
3182499140,10cyclictest27591-21ssh21:11:123
3182499140,10cyclictest24340-21ssh23:31:593
3182499140,10cyclictest23688-21/usr/sbin/munin21:45:233
3182499140,10cyclictest20282-21ssh23:11:453
3182499140,10cyclictest18484-21/usr/sbin/munin22:00:203
3182499140,10cyclictest18239-21ssh21:41:363
3182499140,10cyclictest17657-21ssh21:59:493
3182499140,10cyclictest15624-21sh00:20:413
3182499140,10cyclictest13808-21ssh00:01:563
3182499140,10cyclictest1356-21ssh22:44:043
3182499140,10cyclictest12434-21/usr/sbin/munin20:45:183
3182499140,10cyclictest11307-21wc23:25:123
3181799148,5cyclictest9108-21sendmail-msp00:00:002
3181799147,5cyclictest10724-21ps22:30:412
3181799146,7cyclictest31800-21cyclictest00:23:082
3181799143,8cyclictest17923-21fschecks_count22:35:142
3181799143,8cyclictest17923-21fschecks_count22:35:142
3181799141,9cyclictest3552-21ssh23:20:222
3181799141,9cyclictest17602-21sh21:24:022
3181799141,10cyclictest482-21ssh00:12:442
3181799141,10cyclictest23466-21gltestperf22:20:162
3181799141,10cyclictest21637-21ssh23:30:222
31817991410,3cyclictest11159-21cron19:35:012
3181799140,9cyclictest780-21runrttasks21:00:152
3181799140,9cyclictest31853-21sh22:42:432
3181799140,8cyclictest2327-21sh21:50:252
3181799140,11cyclictest4834-21sh22:27:532
3181799140,10cyclictest9379-21/usr/sbin/munin21:55:232
3181799140,10cyclictest9306-21vmstat23:05:252
3181799140,10cyclictest8518-21ssh22:11:492
3181799140,10cyclictest716-21snmpd20:10:562
3181799140,10cyclictest6695-21ssh22:46:272
3181799140,10cyclictest5207-21cat20:30:002
3181799140,10cyclictest3240-21sh00:32:132
3181799140,10cyclictest31072-21ssh23:18:002
3181799140,10cyclictest30705-21/usr/sbin/munin23:00:232
3181799140,10cyclictest29102-21ssh22:05:202
3181799140,10cyclictest28585-21ssh23:52:132
3181799140,10cyclictest26365-21sh21:10:252
3181799140,10cyclictest23839-21ssh21:27:022
3181799140,10cyclictest23618-21/usr/sbin/munin20:00:242
3181799140,10cyclictest23229-21runrttasks22:02:202
3181799140,10cyclictest21918-21/usr/sbin/munin21:05:242
3181799140,10cyclictest21680-21taskset21:44:002
3181799140,10cyclictest17749-21ssh23:45:552
3181799140,10cyclictest16095-21ssh00:03:312
3181799140,10cyclictest14840-21/usr/sbin/munin20:50:232
3181199145,6cyclictest1-21systemd00:00:021
3181199143,8cyclictest24891-21switchtime20:00:241
3181199143,8cyclictest2441-21tune2fs19:15:141
3181199143,8cyclictest21830-21cat23:30:241
3181199141,9cyclictest5956-21ssh23:21:461
3181199141,9cyclictest28030-21sh00:28:081
3181199141,9cyclictest27921-21ssh22:22:421
3181199141,9cyclictest24373-21runrttasks21:27:241
3181199141,9cyclictest13018-21sh21:39:221
3181199141,9cyclictest11458-21/usr/sbin/munin19:35:111
3181199141,10cyclictest25618-21sh22:39:451
3181199141,10cyclictest25618-21sh22:39:441
3181199141,10cyclictest20341-21runrttasks19:51:421
3181199141,10cyclictest15804-21runrttasks22:51:271
3181199141,10cyclictest11160-21sed21:55:241
3181199140,9cyclictest16425-21ssh22:15:581
3181199140,10cyclictest9976-21sh00:35:331
3181199140,10cyclictest8812-21latency_hist21:55:001
3181199140,10cyclictest8786-21ssh23:05:211
3181199140,10cyclictest8721-21sh22:47:521
3181199140,10cyclictest8495-21kernelversion20:35:171
3181199140,10cyclictest780-21runrttasks22:55:181
3181199140,10cyclictest780-21runrttasks22:14:521
3181199140,10cyclictest6753-21/usr/sbin/munin19:25:171
3181199140,10cyclictest5912-21ssh23:40:051
3181199140,10cyclictest5471-21ssh23:04:041
3181199140,10cyclictest5248-21cat19:20:161
3181199140,10cyclictest31786-21ssh23:35:541
3181199140,10cyclictest31725-21/usr/sbin/munin22:25:171
3181199140,10cyclictest3167-21grep20:25:121
3181199140,10cyclictest30673-21/usr/sbin/munin20:15:151
3181199140,10cyclictest30366-21ssh22:05:461
3181199140,10cyclictest27734-21sh21:11:171
3181199140,10cyclictest26577-21/usr/sbin/munin22:40:131
3181199140,10cyclictest24088-21/usr/sbin/munin23:50:191
3181199140,10cyclictest21064-21ssh00:05:421
3181199140,10cyclictest20944-21/usr/sbin/munin19:55:241
3181199140,10cyclictest20919-21sh22:00:431
3181199140,10cyclictest1716-21ssh00:13:341
3181199140,10cyclictest16370-21/usr/sbin/munin23:10:241
3181199140,10cyclictest16241-21/usr/sbin/munin19:45:201
3181199140,10cyclictest16235-21ssh00:21:051
3181199140,10cyclictest14549-21ssh21:40:091
3181199140,10cyclictest14171-21runrttasks20:45:441
3181199140,10cyclictest13885-21ssh22:32:511
3181199140,10cyclictest1364-21chrt19:10:531
3181199140,10cyclictest12450-21ssh21:20:291
3181199140,10cyclictest10840-21runrttasks19:31:261
3180499146,6cyclictest3401-21find23:20:190
3180499146,6cyclictest326-21systemd-journal20:00:040
3180499145,7cyclictest2570-21/usr/sbin/munin21:15:210
3180499145,7cyclictest24683-21fschecks_time23:50:140
3180499141,9cyclictest6063-21runrttasks19:20:290
3180499141,9cyclictest5884-21runrttasks23:40:030
3180499141,9cyclictest25306-21sh23:15:060
3180499141,9cyclictest17732-21sh21:41:140
3180499141,9cyclictest11055-21sh21:20:150
3180499141,6cyclictest32701-21ps21:50:090
3180499141,11cyclictest11100-21timerandwakeup21:55:230
3180499140,7cyclictest780-21runrttasks19:14:410
3180499140,7cyclictest30281-21head23:35:190
3180499140,7cyclictest21788-21diskstats22:55:150
3180499140,12cyclictest9673-21sh22:30:190
3180499140,12cyclictest23571-21/usr/sbin/munin22:20:170
3180499140,12cyclictest17806-21sh23:45:580
3180499140,11cyclictest20262-21taskset19:50:370
3180499140,10cyclictest9863-21ssh22:12:460
3180499140,10cyclictest780-21runrttasks22:45:310
3180499140,10cyclictest780-21runrttasks20:57:310
3180499140,10cyclictest780-21runrttasks20:57:310
3180499140,10cyclictest28561-21sh21:30:050
3180499140,10cyclictest26311-21sh23:33:230
3180499140,10cyclictest13691-21grep20:45:190
2784229140,8tAtEmLog_028205-21taskset21:30:015
871829130,5tAtEmLog_011137-21chrt00:18:515
3249899130,10tDemoTimingTask1723-21chrt21:15:165
3182899130,9cyclictest7996-21/usr/sbin/munin23:05:154
3182899130,9cyclictest780-21runrttasks21:50:014
3182899130,9cyclictest780-21runrttasks21:07:314
3182899130,9cyclictest780-21runrttasks20:50:094
3182899130,9cyclictest7754-21/usr/sbin/munin00:35:244
3182899130,9cyclictest6749-21runrttasks19:25:084
3182899130,9cyclictest5317-21rm21:35:064
3182899130,9cyclictest455-21runrttasks23:55:044
3182899130,9cyclictest4260-21python320:25:214
3182899130,9cyclictest32084-21apt19:10:124
3182899130,9cyclictest31725-21/usr/sbin/munin22:25:124
3182899130,9cyclictest29132-21/usr/sbin/munin23:35:124
3182899130,9cyclictest28202-21sh22:40:234
3182899130,9cyclictest27490-21ssh00:10:014
3182899130,9cyclictest25971-21/usr/sbin/munin20:05:204
3182899130,9cyclictest24370-21sh21:10:054
3182899130,9cyclictest23992-21sh23:50:074
3182899130,9cyclictest23688-21/usr/sbin/munin21:45:164
3182899130,9cyclictest22506-21ssh22:01:494
3182899130,9cyclictest22151-21sh21:25:504
3182899130,9cyclictest20944-21/usr/sbin/munin19:55:204
3182899130,9cyclictest20347-21postgres19:51:464
3182899130,9cyclictest1838-21sh23:20:024
3182899130,9cyclictest17557-21aten2_r5power_e22:35:124
3182899130,9cyclictest17557-21aten2_r5power_e22:35:124
3182899130,9cyclictest17194-21taskset20:55:114
3182899130,9cyclictest17194-21taskset20:55:114
3182899130,9cyclictest14426-21ssh21:40:034
3182899130,9cyclictest13090-21diskmemload00:20:024
3182899130,9cyclictest12455-21cut20:45:114
3182899130,9cyclictest11458-21/usr/sbin/munin19:35:174
3182899130,9cyclictest10467-21grep21:20:124
3182899130,9cyclictest10171-21wget20:40:124
3182899130,10cyclictest32619-21/usr/sbin/munin23:00:244
3182899130,10cyclictest16885-21taskset22:16:184
3182899130,10cyclictest15641-21chrt19:41:444
3182499134,8cyclictest26281-21if_err_enp6s023:15:173
3182499131,9cyclictest30405-21sh22:05:473
3182499130,9cyclictest8351-21ssh22:11:423
3182499130,9cyclictest7959-21tr20:35:133
3182499130,9cyclictest7184-21ssh23:05:053
3182499130,9cyclictest32035-21cut19:10:013
3182499130,9cyclictest31636-21cut20:15:183
3182499130,9cyclictest30647-21rm21:30:253
3182499130,9cyclictest26331-21runrttasks20:05:143
3182499130,9cyclictest22343-21cpu00:25:103
3182499130,9cyclictest21360-21/usr/sbin/munin22:55:173
3182499130,9cyclictest19848-21python319:50:223
3182499130,9cyclictest19581-21/usr/sbin/munin21:25:203
3182499130,9cyclictest17195-21/usr/sbin/munin20:55:233
3182499130,9cyclictest17195-21/usr/sbin/munin20:55:233
3182499130,9cyclictest14874-21ssh23:45:023
3182499130,9cyclictest14853-21needreboot19:40:173
3182499130,9cyclictest11762-21runrttasks20:40:433
3182499130,10cyclictest7069-21runrttasks20:31:083
3182499130,10cyclictest4400-21/usr/sbin/munin19:20:123
3182499130,10cyclictest28884-21awk00:10:163
3182499130,10cyclictest25492-21sshd20:03:263
3182499130,10cyclictest22616-21taskset19:55:383
3182499130,10cyclictest20536-21grep21:00:183
3182499130,10cyclictest2051-21sh22:25:553
3182499130,10cyclictest16738-21chrt20:53:403
3181799131,9cyclictest5377-21rm21:35:102
3181799131,9cyclictest30702-21switchtime23:35:232
3181799131,9cyclictest30676-21apt-get20:15:122
3181799131,9cyclictest22106-21sh00:25:072
3181799131,7cyclictest6753-21/usr/sbin/munin19:25:102
3181799131,7cyclictest12744-21cpuspeed_turbos20:45:122
3181799130,9cyclictest9380-21ssh23:41:242
3181799130,9cyclictest780-21runrttasks20:58:222
3181799130,9cyclictest780-21runrttasks20:58:222
3181799130,9cyclictest31972-21latency_hist19:10:012
3181799130,9cyclictest2976-21latency_hist20:25:002
3181799130,9cyclictest28701-21sh21:30:112
3181799130,9cyclictest27372-21timerandwakeup20:05:252
3181799130,9cyclictest22647-21taskset19:56:042
3181799130,9cyclictest17758-21unixbench-2d19:45:242
3181799130,9cyclictest13886-21/usr/sbin/munin19:40:182
3181799130,9cyclictest13370-21sh22:15:022
3181799130,9cyclictest12080-21sh22:50:022
3181799130,9cyclictest10080-21/usr/sbin/munin20:40:122
3181799130,10cyclictest8324-21grep20:35:152
3181799130,10cyclictest5889-21timerwakeupswit19:20:222
3181799130,10cyclictest309-21basename19:10:162
3181799130,10cyclictest25137-21python321:45:202
3181799130,10cyclictest19959-21proc_pri00:05:192
3181799130,10cyclictest18947-21df19:50:142
3181799130,10cyclictest11462-21apt-get19:35:092
3181199135,6cyclictest14414-21tune2fs19:40:141
3181199130,9cyclictest780-21runrttasks20:23:561
3181199130,9cyclictest5736-21cut20:30:141
3181199130,9cyclictest31225-21sh00:30:131
3181199130,9cyclictest28713-21/usr/sbin/munin21:30:151
3181199130,9cyclictest28318-21/usr/sbin/munin20:10:111
3181199130,9cyclictest28295-21latency_hist20:10:001
3181199130,9cyclictest22005-21aten2_r5power_p21:05:121
3181199130,9cyclictest18497-21switchtime20:55:241
3181199130,9cyclictest18497-21switchtime20:55:231
3181199130,9cyclictest15046-21/usr/sbin/munin23:45:161
3181199130,9cyclictest1091-21ssh23:55:141
3181199130,9cyclictest10615-21fschecks_time20:40:141
3181199130,10cyclictest716-21snmpd20:50:401
3180499131,10cyclictest31768-21latency_hist19:10:010
3180499130,9cyclictest8348-21unixbench_singl19:25:230
3180499130,9cyclictest780-21runrttasks20:34:100
3180499130,9cyclictest780-21runrttasks20:15:050
3180499130,9cyclictest2420-21fschecks_count19:15:130
3180499130,9cyclictest17146-21missed_timers19:45:180
3180499130,9cyclictest16138-21latency_hist19:45:000
3180499130,9cyclictest1151-21fschecks_time20:20:150
3180499130,7cyclictest174-1kworker/0:1H+kblockd21:07:440
3180499130,7cyclictest174-1kworker/0:1H+kblockd21:04:330
3180499130,10cyclictest9066-21awk20:35:240
3180499130,10cyclictest27923-21runrttasks20:08:500
3180499130,10cyclictest21106-21/usr/sbin/munin19:55:130
3180499130,10cyclictest174-1kworker/0:1H+kblockd19:31:470
2920899131,10tDemoTimingTask30966-21chrt19:05:215
871999120,10tDemoTimingTask15891-21chrt00:20:515
3204529120,10tAtEmLog_01801-21chrt00:13:385
3182499120,9cyclictest32329-21expr19:10:143
3182499120,9cyclictest3003-21/usr/sbin/munin20:25:193
3181799120,7cyclictest5356-21/usr/sbin/munin20:30:112
3181799120,7cyclictest2223-21/usr/sbin/munin19:15:122
3180499120,9cyclictest10652-21fschecks_time20:40:130
3180499120,10cyclictest174-1kworker/0:1H+kblockd20:13:210
2295899120,10tDemoTimingTask23930-21chrt00:07:425
1953799120,10tDemoTimingTask22347-21taskset23:13:145
1333339120,10EcMasterDemoSyn15598-21chrt19:41:105
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional