You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-14 - 13:27
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Thu May 14, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
585239910,0EcMasterDemoSyn586229tAtEmLog_020:40:355
72739830,0EcMasterDemoSyn73929tAtEmLog_023:58:225
2990239830,0EcMasterDemoSyn2991229tAtEmLog_022:27:055
820739820,0EcMasterDemoSyn821729tAtEmLog_020:45:405
727839820,0EcMasterDemoSyn728829tAtEmLog_019:39:445
480739820,0EcMasterDemoSyn481729tAtEmLog_000:18:395
3022739820,0EcMasterDemoSyn3023729tAtEmLog_019:19:275
237739820,0EcMasterDemoSyn238729tAtEmLog_022:11:535
2211639820,0EcMasterDemoSyn2212629tAtEmLog_020:10:115
117239820,0EcMasterDemoSyn118229tAtEmLog_023:22:525
3193139810,0EcMasterDemoSyn3194129tAtEmLog_000:33:535
2142139810,0EcMasterDemoSyn2143129tAtEmLog_021:11:025
1530239790,4EcMasterDemoSyn15309-21runintdemo5min21:00:532
25651992825,2cyclictest3055-21kworker/2:2+events23:58:212
2564399219,10cyclictest5187-21grep21:20:160
560629190,0tAtEmLog_00-21swapper/523:48:125
2887399180,13tDemoTimingTask31972-21chrt23:40:015
2564399185,9cyclictest780-21runrttasks22:15:390
2564399180,10cyclictest20959-21sh23:51:040
863829170,10tAtEmLog_08657-21chrt00:38:565
728999170,7tDemoTimingTask9701-21chrt19:41:305
2565699174,9cyclictest30077-21expr22:45:153
2565199179,6cyclictest17861-21grep22:20:192
2564399179,6cyclictest18575-21grep20:00:210
2564399175,9cyclictest29690-21sh23:20:230
2564399174,9cyclictest23826-21sh00:29:260
2564399170,9cyclictest729-21sh00:15:480
2564399170,9cyclictest1092-21runrttasks22:46:580
2564399170,14cyclictest24764-21ssh22:42:100
2564399170,14cyclictest12051-21idleruntime22:35:170
491839160,0EcMasterDemoSyn0-21swapper/519:34:415
491839160,0EcMasterDemoSyn0-21swapper/519:34:415
2566099168,6cyclictest31469-21wc19:20:174
2565699162,10cyclictest15199-21sed21:25:223
2565699161,9cyclictest17347-21diskmemload00:07:203
2565199168,7cyclictest25638-21cyclictest23:27:282
2565199168,7cyclictest25638-21cyclictest23:27:282
2564899160,10cyclictest5616-21ssh23:43:091
2564399160,9cyclictest780-21runrttasks19:12:410
2564399160,9cyclictest30648-21ssh00:32:570
2564399160,7cyclictest24589-21ssh00:11:070
2564399160,14cyclictest25762-21taskset20:15:220
2564399160,10cyclictest20719-21sh21:28:580
3261699150,9tDemoTimingTask32620-21chrt19:24:335
302399150,9tDemoTimingTask31267-21sleep21:39:555
2808929150,9tAtEmLog_028181-21taskset00:13:385
2566099154,8cyclictest716-21snmpd23:38:214
2566099152,9cyclictest2937-21/usr/sbin/munin19:30:144
2566099152,9cyclictest2937-21/usr/sbin/munin19:30:144
25660991511,3cyclictest14407-21cpuspeed_turbos23:30:124
2566099151,10cyclictest32274-21sh00:34:044
2566099150,9cyclictest19630-21sh22:57:034
2566099150,9cyclictest15146-21ssh23:12:394
2566099150,9cyclictest10750-21sh21:23:244
2566099150,8cyclictest26376-21runrttasks21:49:594
2565699157,6cyclictest26288-21sed22:25:153
2565699154,8cyclictest27418-21date21:15:003
2565699150,9cyclictest31591-21ssh23:57:153
2565199151,10cyclictest29884-21runrttasks00:32:242
2565199150,9cyclictest13911-21sensors_fan19:50:182
2564899151,10cyclictest29475-21ssh00:14:331
2564899151,10cyclictest22713-21/usr/sbin/munin21:30:171
2564899151,10cyclictest22713-21/usr/sbin/munin21:30:171
2564899150,9cyclictest18063-21diskmemload23:21:101
2564899150,9cyclictest15022-21timerandwakeup21:00:241
2564399156,7cyclictest23228-21/usr/sbin/munin20:10:180
2564399156,7cyclictest10556-21ssh22:34:550
2564399155,6cyclictest1846-21ssh21:54:090
25643991513,2cyclictest23050irq/32-nvkm22:11:520
2564399151,10cyclictest6118-21sh23:07:370
2564399151,10cyclictest326-21systemd-journal20:35:000
25643991510,3cyclictest16480-21runintdemo5min22:01:440
2564399150,8cyclictest334-21sh22:29:070
2564399150,8cyclictest326-21systemd-journal23:46:430
2564399150,7cyclictest29153-21cat20:24:590
2497299150,12tDemoTimingTask30023-21taskset22:45:155
2482129150,6tAtEmLog_026289-21chrt20:16:595
1232799150,9tDemoTimingTask10030-21sleep19:49:565
2566099147,6cyclictest25638-21cyclictest00:13:404
2566099146,6cyclictest4019-21diskstats21:55:134
2566099143,8cyclictest716-21snmpd21:12:214
2566099143,8cyclictest716-21snmpd20:39:214
2566099143,8cyclictest24511-21cut23:00:114
2566099141,9cyclictest6443-21sh21:38:464
25660991411,2cyclictest0-21swapper/422:40:244
2566099141,10cyclictest15814-21ssh23:48:484
2566099140,10cyclictest780-21runrttasks22:46:484
2566099140,10cyclictest780-21runrttasks00:23:504
2566099140,10cyclictest5961-21sh00:00:374
2566099140,10cyclictest25325-21sh22:25:024
2566099140,10cyclictest1912-21sh23:23:224
2566099140,10cyclictest17848-21chrt21:07:164
2566099140,10cyclictest15776-21ssh22:19:554
2566099140,10cyclictest15071-21aten2_r5power_e19:55:124
2565699148,5cyclictest9453-21tail21:40:133
2565699145,7cyclictest20048-21latency_hist22:40:003
2565699144,8cyclictest29413-21/usr/sbin/munin20:25:123
2565699144,6cyclictest728-21lldpd21:02:163
2565699144,5cyclictest16015-21cat19:55:183
2565699143,8cyclictest14969-21cat19:55:013
2565699141,9cyclictest7968-21/usr/sbin/munin19:40:173
2565699141,9cyclictest5064-21sh22:31:033
2565699141,9cyclictest26483-21runrttasks20:19:383
2565699141,10cyclictest27603-21latency_hist23:20:003
2565699141,10cyclictest15112-21runrttasks22:19:273
2565699141,10cyclictest1411-21cat20:35:003
2565699140,9cyclictest78050runrttasks19:26:413
2565699140,9cyclictest527-21sh00:15:413
2565699140,10cyclictest973-21sh23:40:173
2565699140,10cyclictest9689-21ssh00:39:403
2565699140,10cyclictest8486-21runrttasks20:48:543
2565699140,10cyclictest826-21rm22:10:483
2565699140,10cyclictest5355-21grep23:25:123
2565699140,10cyclictest5355-21grep23:25:113
2565699140,10cyclictest5164-21sh23:06:563
2565699140,10cyclictest445-21/usr/sbin/munin21:35:153
2565699140,10cyclictest32748-21ssh21:53:053
2565699140,10cyclictest30797-21ssh00:33:033
2565699140,10cyclictest30592-21ssh21:16:023
2565699140,10cyclictest28650-21ssh23:02:023
2565699140,10cyclictest28012-21sh23:20:053
2565699140,10cyclictest26913-21ssh22:07:403
2565699140,10cyclictest26546-21sh23:36:263
2565699140,10cyclictest24177-21runrttasks22:24:253
2565699140,10cyclictest24160-21latency_hist20:15:003
2565699140,10cyclictest18927-21grep21:45:173
2565699140,10cyclictest14032-21ssh23:11:513
2565699140,10cyclictest13942-21sh23:30:043
2565699140,10cyclictest10111-21sh22:51:433
2565199145,8cyclictest598-21/usr/sbin/munin19:25:112
2565199145,7cyclictest711-21gdbus20:10:182
2565199145,7cyclictest6969-21ssh21:56:242
2565199143,8cyclictest29108-21sed23:20:172
2565199142,9cyclictest3587-21diskmemload00:00:052
2565199141,9cyclictest780-21runrttasks19:57:582
2565199141,9cyclictest19292-21ssh22:56:492
2565199141,9cyclictest17334-21ssh23:31:182
2565199141,9cyclictest10011-21diskmemload00:21:002
2565199141,10cyclictest24227-21sh23:00:042
2565199141,10cyclictest11037-21sh22:52:232
25651991410,3cyclictest10929-21sh20:54:592
2565199140,9cyclictest780-21runrttasks20:49:222
2565199140,10cyclictest9923-21ssh22:15:482
2565199140,10cyclictest9818-21ssh21:22:442
2565199140,10cyclictest9115-21apt-get23:45:122
2565199140,10cyclictest8678-21ssh21:40:072
2565199140,10cyclictest8483-21sh23:09:162
2565199140,10cyclictest780-21runrttasks20:19:382
2565199140,10cyclictest780-21runrttasks20:07:572
2565199140,10cyclictest7409-21sh22:32:422
2565199140,10cyclictest5019-21sh00:36:212
2565199140,10cyclictest4760-21ssh21:37:342
2565199140,10cyclictest4032-21sh22:13:002
2565199140,10cyclictest31891-21sh22:45:492
2565199140,10cyclictest31547-21/usr/sbin/munin20:30:192
2565199140,10cyclictest30638-21/usr/sbin/munin19:20:162
2565199140,10cyclictest30585-21ssh21:51:342
2565199140,10cyclictest28191-21sh22:25:542
2565199140,10cyclictest27616-21sh21:15:042
2565199140,10cyclictest27523-21idleruntime20:20:162
2565199140,10cyclictest26271-21diskstats19:10:132
2565199140,10cyclictest26232-21ssh21:31:282
2565199140,10cyclictest26232-21ssh21:31:272
2565199140,10cyclictest25639-21sh00:11:512
2565199140,10cyclictest25205-21ssh22:42:272
2565199140,10cyclictest22895-21ssh22:05:172
2565199140,10cyclictest22616-21ssh00:28:372
2565199140,10cyclictest2086-21ssh00:16:452
2565199140,10cyclictest20791-21ssh21:10:362
2565199140,10cyclictest20509-21ssh23:15:202
2565199140,10cyclictest20161-21sh23:50:302
2565199140,10cyclictest19883-21sh21:28:242
2565199140,10cyclictest19332-21ssh21:45:202
2565199140,10cyclictest17956-21chrt21:08:452
2565199140,10cyclictest17846-21ssh00:07:412
2565199140,10cyclictest15119-21sh23:12:362
2565199140,10cyclictest13501-21sh22:00:152
2564899143,8cyclictest30892-21swap22:45:231
2564899141,9cyclictest780-21runrttasks22:39:141
2564899141,9cyclictest6908-21fschecks_count20:45:151
2564899141,9cyclictest23142-21/usr/sbin/munin23:35:231
2564899141,9cyclictest10096-21sh00:21:031
2564899141,10cyclictest31512-21ssh21:16:371
2564899141,10cyclictest22880-21sh22:40:501
2564899141,10cyclictest19175-21runrttasks20:01:211
2564899141,10cyclictest16-1pr/legacy22:32:081
2564899141,10cyclictest11296-21sh23:45:361
2564899140,8cyclictest1202350cat21:59:561
2564899140,11cyclictest4831-21cut21:20:141
2564899140,10cyclictest9916-21sh23:27:271
2564899140,10cyclictest9916-21sh23:27:271
2564899140,10cyclictest9273-21ssh22:51:081
2564899140,10cyclictest7059-21sh21:39:111
2564899140,10cyclictest530-21/usr/sbin/munin19:25:171
2564899140,10cyclictest4171-21/usr/sbin/munin20:40:131
2564899140,10cyclictest31645-21basename20:30:111
2564899140,10cyclictest30638-21/usr/sbin/munin19:20:121
2564899140,10cyclictest29592-21sh22:26:531
2564899140,10cyclictest29196-21/usr/sbin/munin20:25:191
2564899140,10cyclictest28750-21ssh22:08:591
2564899140,10cyclictest27921-21runrttasks19:14:371
2564899140,10cyclictest27464-21df23:55:131
2564899140,10cyclictest26844-21sh21:50:051
2564899140,10cyclictest25563-21awk20:15:211
2564899140,10cyclictest25085-21sh00:30:081
2564899140,10cyclictest23581-21ssh00:29:161
2564899140,10cyclictest2283-21perl00:35:141
2564899140,10cyclictest21975-21runrttasks23:51:481
2564899140,10cyclictest21716-21chrt20:08:541
2564899140,10cyclictest21468-21ssh23:15:411
2564899140,10cyclictest20943-21ssh21:29:091
2564899140,10cyclictest19893-21ssh22:57:141
2564899140,10cyclictest19237-21fschecks_time21:10:161
2564899140,10cyclictest19227-21ssh22:20:571
2564899140,10cyclictest17009-21chrt19:59:101
2564899140,10cyclictest15563-21sh22:19:451
2564899140,10cyclictest14116-21grep23:30:111
2564899140,10cyclictest13842-21sendmail_mailqu19:50:181
2564899140,10cyclictest13203-21runrttasks20:59:071
2564899140,10cyclictest12724-21aten2_r5power_c22:00:111
2564899140,10cyclictest12706-21/usr/sbin/munin00:05:221
2564899140,10cyclictest12063-21rm23:10:261
2564899140,10cyclictest11552-21ssh21:41:001
2564399146,6cyclictest32193-21apt-get23:40:100
2564399146,6cyclictest22455-21sh23:16:240
2564399145,7cyclictest25117-21ssh22:06:270
2564399145,7cyclictest1773-21ssh21:18:300
2564399145,7cyclictest16902-21ssh22:20:120
2564399145,7cyclictest1508-21ssh00:35:020
2564399144,5cyclictest22482-21seq21:11:450
2564399143,6cyclictest4121-21ssh21:37:070
2564399141,9cyclictest17766-21sh22:55:440
2564399141,12cyclictest31550-21apt-get20:30:100
2564399140,9cyclictest13869-21ssh23:30:010
2564399140,7cyclictest8109-21basename00:20:160
2564399140,7cyclictest28010-21ssh23:37:290
2564399140,7cyclictest27380-21grep23:55:120
2564399140,7cyclictest22608-21ssh21:30:070
2564399140,7cyclictest22608-21ssh21:30:070
2564399140,6cyclictest780-21runrttasks20:46:590
2564399140,12cyclictest19146-21sh21:45:190
2564399140,10cyclictest9708-21ssh21:58:180
2564399140,10cyclictest8999-21ssh22:50:560
2564399140,10cyclictest4830-21needreboot00:00:170
2564399140,10cyclictest28886-21sed19:15:150
2564399140,10cyclictest26983-21rm23:00:510
2564399140,10cyclictest18288-21ssh00:08:000
2564399140,10cyclictest16156-21sh23:13:170
2564399140,10cyclictest11844-21ssh23:28:470
2564399140,10cyclictest11844-21ssh23:28:470
2564399140,10cyclictest10769-21sh21:40:260
1648599140,11tDemoTimingTask21707-21chrt22:05:115
3070839130,2EcMasterDemoSyn651irq_work/521:16:065
2566099135,6cyclictest27344-21perl20:20:144
2566099133,7cyclictest728-21lldpd20:16:084
2566099131,9cyclictest7968-21/usr/sbin/munin19:40:204
2566099131,9cyclictest3743-21rm00:35:264
2566099130,9cyclictest964-21ssh23:05:074
2566099130,9cyclictest8637-21ssh21:40:054
2566099130,9cyclictest780-21runrttasks20:45:044
2566099130,9cyclictest716-21snmpd20:14:354
2566099130,9cyclictest716-21snmpd19:25:064
2566099130,9cyclictest6133-21chrt20:43:524
2566099130,9cyclictest5329-21wget19:35:114
2566099130,9cyclictest32559-21/usr/sbin/munin20:30:184
2566099130,9cyclictest29978-21sh21:51:094
2566099130,9cyclictest28257-21runrttasks19:15:084
2566099130,9cyclictest26114-21cpuspeed_turbos19:10:124
2566099130,9cyclictest21910-21sh22:05:124
2566099130,9cyclictest20051-21sh23:50:264
2566099130,9cyclictest19805-21/usr/sbin/munin20:05:244
2566099130,9cyclictest18264-21ssh00:25:304
2566099130,9cyclictest17395-21chrt20:00:014
2566099130,9cyclictest16534-21sh21:26:054
2566099130,9cyclictest15927-21date21:05:014
2566099130,9cyclictest14619-21sh22:36:264
2566099130,9cyclictest13076-21/usr/sbin/munin22:00:124
2566099130,9cyclictest12664-21runrttasks19:50:044
2566099130,9cyclictest11988-21cut20:55:164
2566099130,10cyclictest960-21sh22:10:534
2566099130,10cyclictest9291-21tune2fs20:50:134
2566099130,10cyclictest6708-21runrttasks23:25:224
2566099130,10cyclictest6708-21runrttasks23:25:224
2566099130,10cyclictest32259-21threads00:15:234
2566099130,10cyclictest3217-21ssh23:41:274
2566099130,10cyclictest30262-21ntp_offset20:25:184
2566099130,10cyclictest29304-21ssh21:15:244
2566099130,10cyclictest27888-21chrt23:55:154
2566099130,10cyclictest25021-21ssh21:30:404
2566099130,10cyclictest25021-21ssh21:30:404
2566099130,10cyclictest2459-21sort22:30:134
2566099130,10cyclictest23002-21ssh23:16:474
2566099130,10cyclictest16352-21sh22:20:024
2566099130,10cyclictest15053-21sh00:05:424
2566099130,10cyclictest14197-21sh22:54:364
2565699131,9cyclictest4306-21ssh00:00:143
2565699130,9cyclictest8875-21/usr/sbin/munin20:50:103
2565699130,9cyclictest780-21runrttasks19:21:593
2565699130,9cyclictest4171-21/usr/sbin/munin20:40:183
2565699130,9cyclictest3857-21/usr/sbin/munin21:55:123
2565699130,9cyclictest28261-21/usr/sbin/munin19:15:143
2565699130,9cyclictest26907-21tr20:20:123
2565699130,9cyclictest21642-21/usr/sbin/munin00:10:193
2565699130,9cyclictest18030-21sh23:50:083
2565699130,9cyclictest1794-21/usr/sbin/munin20:35:203
2565699130,9cyclictest17208-21unixbench-2d22:55:253
2565699130,9cyclictest17154-21latency00:25:173
2565699130,9cyclictest16005-21/usr/sbin/munin21:05:173
2565699130,9cyclictest12787-21aten2_r5power_p22:00:113
2565699130,9cyclictest11898-21hddtemp_smartct20:55:143
2565699130,10cyclictest9005-21ssh23:45:083
2565699130,10cyclictest780-21runrttasks19:33:083
2565699130,10cyclictest780-21runrttasks19:33:083
2565699130,10cyclictest7283-21rm00:20:103
2565699130,10cyclictest5649-21df_inode19:35:143
2565699130,10cyclictest4411-21sh21:20:073
2565699130,10cyclictest23292-21perl21:30:153
2565699130,10cyclictest23292-21perl21:30:143
2565699130,10cyclictest21823-21ssh22:40:223
2565699130,10cyclictest20356-21cut20:05:143
2565199131,9cyclictest29340-21open_files19:15:192
2565199130,9cyclictest780-21runrttasks19:41:272
2565199130,9cyclictest767-21diskmemload23:40:162
2565199130,9cyclictest716-21snmpd19:47:212
2565199130,9cyclictest5520-21cpuspeed_turbos19:35:132
2565199130,9cyclictest4517-21awk19:30:242
2565199130,9cyclictest4517-21awk19:30:232
2565199130,9cyclictest18547-21runrttasks20:00:212
2565199130,9cyclictest12399-21sendmail_mailqu20:55:192
2565199130,9cyclictest12258-21ssh22:35:182
2565199130,9cyclictest1-21systemd20:26:272
2565199130,10cyclictest4805-21gltestperf20:40:152
2565199130,10cyclictest25542-21ssh23:35:442
2565199130,10cyclictest1805-21aten2_r5power_c20:35:122
2564899131,9cyclictest23884-21runrttasks20:11:251
2564899130,9cyclictest900-21sh23:05:051
2564899130,9cyclictest8889-21aten2_r5power_c20:50:101
2564899130,9cyclictest5789-21sh00:00:291
2564899130,9cyclictest2937-21/usr/sbin/munin19:30:231
2564899130,9cyclictest2937-21/usr/sbin/munin19:30:221
2564899130,9cyclictest25884-21latency_hist19:10:001
2564899130,9cyclictest16005-21/usr/sbin/munin21:05:121
2564899130,9cyclictest10316-21runrttasks19:45:061
2564899130,10cyclictest780-21runrttasks23:00:051
2564899130,10cyclictest6890-21grep19:35:241
2564899130,10cyclictest3517-21runrttasks20:35:391
2564899130,10cyclictest31099-21sh00:15:121
2564899130,10cyclictest30758-21/usr/sbin/munin22:10:111
2564899130,10cyclictest29894-21uptime19:15:241
2564899130,10cyclictest26843-21/usr/sbin/munin20:20:141
2564899130,10cyclictest17714-21ssh21:45:041
2564399136,6cyclictest7049-21sshd19:36:450
2564399131,9cyclictest780-21runrttasks21:01:150
2564399131,9cyclictest780-21runrttasks19:40:390
2564399130,9cyclictest4206-21wget20:40:120
2564399130,9cyclictest32694-21munin-plugin-st19:25:000
2564399130,9cyclictest30255-21ntpq20:25:190
2564399130,9cyclictest19458-21latency_hist20:05:010
2564399130,7cyclictest8940-21/usr/sbin/munin20:50:110
2564399130,11cyclictest648-21dbus-daemon19:50:180
2564399130,10cyclictest174-1kworker/0:1H+kblockd19:28:300
2564399130,10cyclictest16343-21ls21:05:120
2564399130,10cyclictest12425-21date19:50:010
2314799130,11tDemoTimingTask25278-21chrt19:06:355
80999120,10tDemoTimingTask1117-21chrt20:34:105
618339120,1EcMasterDemoSyn0-21swapper/523:12:275
2945729120,2tAtEmLog_029472-21chrt23:02:365
2596839120,0EcMasterDemoSyn0-21swapper/521:31:195
2596839120,0EcMasterDemoSyn0-21swapper/521:31:195
2566099120,9cyclictest10446-21grep19:45:134
2565699124,6cyclictest17888-21fschecks_count20:00:143
2565699120,9cyclictest780-21runrttasks19:10:393
2565699120,9cyclictest10319-21runrttasks19:45:083
2565699120,7cyclictest25672-21latency_hist19:10:003
2564899120,9cyclictest7956-21runrttasks19:40:011
2564399120,9cyclictest3610-21smartctl19:30:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional