You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-20 - 07:14
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Sat Jun 20, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1723639910,0EcMasterDemoSyn0-21swapper/400:11:204
304939830,0EcMasterDemoSyn305929tAtEmLog_000:21:285
2053639830,0EcMasterDemoSyn0-21swapper/119:12:091
914539820,0EcMasterDemoSyn915529tAtEmLog_023:30:465
914539820,0EcMasterDemoSyn915529tAtEmLog_023:30:455
1815839820,0EcMasterDemoSyn1816829tAtEmLog_019:07:055
1723639820,0EcMasterDemoSyn1724629tAtEmLog_000:11:195
1423839820,0EcMasterDemoSyn1424829tAtEmLog_023:15:345
1175039820,0EcMasterDemoSyn1176029tAtEmLog_021:08:475
459839810,0EcMasterDemoSyn460829tAtEmLog_020:53:345
2787539810,0EcMasterDemoSyn2788529tAtEmLog_021:54:255
18491993835,2cyclictest22618-21kworker/4:1+events21:15:054
23662340,0sleep40-21swapper/400:21:004
18487992826,2cyclictest13552-21kworker/3:2+events22:17:413
18491992623,2cyclictest22618-21kworker/4:1+events22:21:064
18491992119,1cyclictest22618-21kworker/4:1+events20:36:534
18491992118,2cyclictest22618-21kworker/4:1+events23:56:414
18491992118,2cyclictest22618-21kworker/4:1+events23:56:414
18491992118,2cyclictest22618-21kworker/4:1+events20:12:584
18487992119,2cyclictest13552-21kworker/3:2+events22:35:293
18487992117,3cyclictest13552-21kworker/3:2+events23:59:133
18487992117,3cyclictest13552-21kworker/3:2+events23:59:123
18487992018,2cyclictest13552-21kworker/3:2+events20:30:493
18487992017,2cyclictest13552-21kworker/3:2+events20:03:123
1847299206,10cyclictest780-21runrttasks21:09:530
18491991916,2cyclictest22618-21kworker/4:1+events23:24:394
18482991917,2cyclictest12969-21kworker/2:0+events19:21:532
18482991916,2cyclictest12969-21kworker/2:0+events20:50:252
1847299190,10cyclictest780-21runrttasks00:19:090
18491991815,2cyclictest22618-21kworker/4:1+events00:36:064
18487991816,2cyclictest13552-21kworker/3:2+events20:56:363
18487991815,2cyclictest13552-21kworker/3:2+events00:33:143
18482991816,2cyclictest7101-21kworker/2:2+events22:51:282
18482991815,2cyclictest12969-21kworker/2:0+events20:29:252
1847299180,10cyclictest32734-21ntp_offset22:50:170
3171099170,10tDemoTimingTask31741-21chrt20:43:295
2341499170,10tDemoTimingTask29527-21chrt23:24:555
18491991715,2cyclictest22618-21kworker/4:1+events20:34:294
18491991714,2cyclictest22618-21kworker/4:1+events23:45:514
1849199170,9cyclictest18120-21ssh23:35:464
1849199170,9cyclictest11975-21chrt23:32:444
1849199170,9cyclictest11975-21chrt23:32:444
18487991715,2cyclictest13552-21kworker/3:2+events23:46:483
18482991714,2cyclictest7101-21kworker/2:2+events21:48:572
1847299175,9cyclictest19623-21sh22:07:200
1847299170,9cyclictest780-21runrttasks19:37:020
1847299170,9cyclictest780-21runrttasks19:37:020
1847299170,9cyclictest5367-21sh23:46:530
1847299170,9cyclictest27393-21ssh21:35:280
1847299170,9cyclictest25732-21sh22:29:000
1847299170,9cyclictest17737-21sh21:48:450
1847299170,9cyclictest12428-21sh00:26:440
1847299170,14cyclictest13084-21sh23:51:000
940599160,10tDemoTimingTask9436-21chrt21:03:465
2841599160,9tDemoTimingTask30323-21chrt21:20:015
2764399160,9tDemoTimingTask27728-21chrt19:27:255
2703729160,6tAtEmLog_032220-21taskset22:32:105
2528629160,6tAtEmLog_025433-21taskset19:23:545
1863399160,10tDemoTimingTask18762-21taskset21:49:255
18491991614,2cyclictest22618-21kworker/4:1+events21:01:384
18487991613,2cyclictest13552-21kworker/3:2+events22:55:053
1848299168,7cyclictest18466-21cyclictest23:15:112
1847899165,8cyclictest14195-21python320:05:271
18478991614,2cyclictest18357-21kworker/1:1+events22:47:241
18478991612,3cyclictest1-21systemd00:40:001
1847899160,9cyclictest780-21runrttasks20:27:371
1847299160,9cyclictest780-21runrttasks20:25:560
1847299160,9cyclictest780-21runrttasks19:34:080
1847299160,7cyclictest21892-21/usr/sbin/munin23:20:140
1847299160,13cyclictest23934-21sh00:33:330
1847299160,13cyclictest19310-21ssh22:43:100
1847299160,10cyclictest31723-21ntp_kernel_err21:20:170
1210839160,0EcMasterDemoSyn0-21swapper/500:26:335
1849199155,8cyclictest9839-21/usr/sbin/munin21:05:114
1849199154,8cyclictest21244-21systemctl20:20:204
1849199153,8cyclictest752-21postgres23:00:024
1849199152,9cyclictest780-21runrttasks22:08:444
18491991512,2cyclictest22618-21kworker/4:1+events19:42:514
1848799157,7cyclictest18466-21cyclictest22:47:233
1848799154,8cyclictest716-21snmpd00:23:423
1848799154,8cyclictest24500-21expr00:15:243
18487991512,2cyclictest13552-21kworker/3:2+events21:53:533
18487991512,2cyclictest13552-21kworker/3:2+events19:48:183
1848799151,10cyclictest2701-21/usr/sbin/munin20:50:213
1848799150,10cyclictest30757-21ssh21:37:493
1848799150,10cyclictest24788-21sh23:21:343
1848299154,8cyclictest728-21lldpd21:11:332
18482991512,2cyclictest7101-21kworker/2:2+events22:09:552
18482991511,3cyclictest6669-21turbostat21:25:002
1848299150,9cyclictest780-21runrttasks22:46:552
1848299150,9cyclictest11046-21ssh22:38:442
1847899153,9cyclictest28018-21swap23:05:211
18478991513,2cyclictest18357-21kworker/1:1+events20:42:211
18478991511,3cyclictest18357-21kworker/1:1+events23:53:291
1847899151,10cyclictest1515750latency_hist23:35:001
1847899151,10cyclictest1515750latency_hist23:35:001
1847899150,8cyclictest7049-21sh22:35:541
1847299159,5cyclictest19309-21cut19:10:140
1847299155,8cyclictest17742-21sh21:30:210
1847299154,8cyclictest12428-21cut20:07:550
1847299150,9cyclictest28462-21ssh21:18:560
1847299150,6cyclictest6022-21ssh00:05:190
1847299150,13cyclictest10757-21sh23:14:280
1847299150,11cyclictest20186-21sh23:00:560
3189239140,7EcMasterDemoSyn31898-21ps22:50:124
2354199140,12tDemoTimingTask23597-21taskset21:34:095
1849199147,5cyclictest25200-21grep22:10:184
1849199143,8cyclictest12374-21wc21:45:194
1849199143,8cyclictest11252-21idleruntime20:00:154
1849199141,9cyclictest25549-21sh22:46:134
1849199141,9cyclictest20783-21runrttasks21:32:124
1849199141,9cyclictest13099-21/usr/sbin/munin20:05:134
1849199141,10cyclictest2548-21ssh00:03:394
1849199140,9cyclictest20078-21switchtime19:10:224
1849199140,9cyclictest10993-21ssh00:25:464
1849199140,12cyclictest994-21ssh21:21:034
1849199140,11cyclictest463-21ssh23:25:564
1849199140,10cyclictest4080-21grep22:35:004
1849199140,10cyclictest2864-21sh23:10:014
1849199140,10cyclictest15211-21ssh23:16:134
1849199140,10cyclictest11306-21ssh22:38:564
1849199140,10cyclictest10280-21ssh21:44:494
1849199140,10cyclictest10255-21/usr/sbin/munin23:50:184
1848799146,6cyclictest711-21gdbus23:30:193
1848799146,6cyclictest711-21gdbus23:30:193
1848799144,6cyclictest1-21systemd23:25:213
1848799143,8cyclictest8578-21forks19:55:143
1848799142,9cyclictest30902-21sh23:07:063
1848799142,9cyclictest13536-21sh23:15:193
1848799141,9cyclictest780-21runrttasks21:45:273
1848799141,9cyclictest3059-21apt-get23:10:093
1848799141,9cyclictest26127-21ssh22:10:323
1848799141,9cyclictest16248-21/usr/sbin/munin21:30:123
18487991412,2cyclictest13552-21kworker/3:2+events00:10:393
18487991411,2cyclictest13552-21kworker/3:2+events00:37:133
1848799141,10cyclictest20024-21/usr/sbin/munin20:20:193
1848799140,9cyclictest19379-21taskset20:16:273
1848799140,9cyclictest17390-21sh22:41:493
1848799140,10cyclictest9903-21aten2_r5power_p21:05:133
1848799140,10cyclictest9460-21sh00:07:103
1848799140,10cyclictest780-21runrttasks22:20:423
1848799140,10cyclictest5690-21ssh22:00:013
1848799140,10cyclictest4864-21ssh21:41:033
1848799140,10cyclictest32720-21ssh22:32:313
1848799140,10cyclictest32313-21apt-key20:45:003
1848799140,10cyclictest31740-21ntp_kernel_pll_21:20:173
1848799140,10cyclictest31379-21ssh22:50:063
1848799140,10cyclictest30645-21wget19:35:113
1848799140,10cyclictest30645-21wget19:35:113
1848799140,10cyclictest27887-21chrt19:29:353
1848799140,10cyclictest27021-21ssh21:18:003
1848799140,10cyclictest23518-21sh22:27:263
1848799140,10cyclictest22669-21ssh22:09:293
1848799140,10cyclictest15948-21hddtemp_smartct20:10:153
1848799140,10cyclictest13492-21rm21:28:283
1848799140,10cyclictest12438-21sh23:50:333
1848299143,8cyclictest9698-21timerwakeupswit19:55:242
1848299143,8cyclictest27725-21apache220:15:392
1848299141,9cyclictest5914-21/usr/sbin/munin22:00:182
1848299141,9cyclictest17054-21cat23:00:002
1848299141,10cyclictest4670-21sendmail_mailqu19:45:202
18482991410,3cyclictest31866-21turbostat20:45:002
18482991410,3cyclictest12633-21turbostat20:05:002
1848299140,8cyclictest10084-21diskmemload00:07:372
1848299140,2cyclictest0-21swapper/220:10:002
1848299140,10cyclictest9306-21ssh23:30:502
1848299140,10cyclictest9306-21ssh23:30:502
1848299140,10cyclictest780-21runrttasks23:47:052
1848299140,10cyclictest780-21runrttasks19:26:492
1848299140,10cyclictest7034-21ssh21:25:042
1848299140,10cyclictest6400-21perl19:50:132
1848299140,10cyclictest5526-21rm23:10:432
1848299140,10cyclictest3447-21sh22:16:002
1848299140,10cyclictest326-21systemd-journal21:40:102
1848299140,10cyclictest2982-21sh00:21:262
1848299140,10cyclictest29684-21df_inode21:55:132
1848299140,10cyclictest29207-21ssh00:35:562
1848299140,10cyclictest29164-21mailstats22:30:182
1848299140,10cyclictest28738-21latency_hist21:55:002
1848299140,10cyclictest26486-21ssh00:16:312
1848299140,10cyclictest25339-21/usr/sbin/munin21:35:132
1848299140,10cyclictest23682-21sh23:03:262
1848299140,10cyclictest22961-21runrttasks19:17:352
1848299140,10cyclictest21151-21/usr/sbin/munin23:20:202
1848299140,10cyclictest19534-21ssh00:30:262
1848299140,10cyclictest1786-21ssh23:26:562
1848299140,10cyclictest16654-21ssh22:41:182
1848299140,10cyclictest16449-21sh00:10:472
1848299140,10cyclictest16096-21sh21:30:042
1848299140,10cyclictest15690-21/usr/sbin/munin23:35:152
1848299140,10cyclictest12335-21ssh23:50:282
1848299140,10cyclictest11551-21runrttasks21:06:112
1847899141,9cyclictest23463-21runrttasks19:20:041
1847899141,9cyclictest20303-21sh22:43:531
1847899141,9cyclictest17511-21sh00:30:091
1847899141,7cyclictest12204-21sed21:45:171
18478991412,2cyclictest18357-21kworker/1:1+events19:36:351
18478991412,2cyclictest18357-21kworker/1:1+events19:36:351
1847899141,10cyclictest780-21runrttasks19:25:291
1847899140,7cyclictest18459-21ssh23:00:161
1847899140,10cyclictest8786-21tr19:55:151
1847899140,10cyclictest7977-21cut21:00:151
1847899140,10cyclictest780-21runrttasks20:12:381
1847899140,10cyclictest7044-21sh00:05:301
1847899140,10cyclictest6441-21ssh21:42:081
1847899140,10cyclictest5284-21sh22:17:181
1847899140,10cyclictest5059-21apt-get20:55:121
1847899140,10cyclictest3055-21df_inode20:50:121
1847899140,10cyclictest30299-21runrttasks21:37:291
1847899140,10cyclictest29446-21missed_timers00:00:171
1847899140,10cyclictest29275-21/usr/sbin/munin21:55:191
1847899140,10cyclictest2877-21ssh21:22:231
1847899140,10cyclictest28480-21ntpq20:35:181
1847899140,10cyclictest27578-21ssh22:30:041
1847899140,10cyclictest25247-21open_inodes22:10:191
1847899140,10cyclictest24567-21ssh23:40:061
1847899140,10cyclictest23508-21ssh21:51:251
1847899140,10cyclictest23492-21sh23:57:011
1847899140,10cyclictest23492-21sh23:57:001
1847899140,10cyclictest21082-21runrttasks19:15:021
1847899140,10cyclictest18598-21ssh22:25:061
1847899140,10cyclictest18259-21sh23:35:501
1847899140,10cyclictest17948-21ssh22:06:101
1847899140,10cyclictest17444-21diskmemload21:12:381
1847899140,10cyclictest16219-21rm00:29:261
1847899140,10cyclictest16050-21sh21:30:011
1847899140,10cyclictest14306-21ssh23:15:341
1847899140,10cyclictest13999-21/usr/sbin/munin00:10:121
1847299148,5cyclictest26451-21sed23:40:230
1847299148,2cyclictest28953-21fschecks_time00:00:140
1847299146,6cyclictest780-21runrttasks19:19:250
1847299146,6cyclictest26116-21ssh22:46:360
1847299145,8cyclictest12535-21basename21:10:120
1847299142,9cyclictest4328-21sh22:35:080
1847299142,9cyclictest16245-21fschecks_time23:35:140
1847299142,5cyclictest27663-21ntpq23:05:170
1847299141,9cyclictest780-21runrttasks20:48:250
1847299141,9cyclictest780-21runrttasks20:38:140
18472991412,2cyclictest23050irq/32-nvkm21:26:450
1847299141,11cyclictest9603-21cat21:05:000
1847299141,11cyclictest1240-21grep22:15:140
18472991410,3cyclictest2255-21cpuspeed21:40:120
1847299140,8cyclictest32717-21latency_hist22:15:010
1847299140,7cyclictest8233-21ssh22:55:050
1847299140,7cyclictest32485-21ps23:25:400
1847299140,7cyclictest31133-21/usr/sbin/munin21:55:240
1847299140,7cyclictest12645-21fschecks_time23:15:120
1847299140,12cyclictest25692-21sh23:58:340
1847299140,12cyclictest25692-21sh23:58:340
1847299140,12cyclictest11397-21cat22:20:230
1847299140,10cyclictest8221-21aten2_r5power_c19:55:120
1847299140,10cyclictest780-21runrttasks00:37:130
1847299140,10cyclictest744-21postgres23:32:580
1847299140,10cyclictest744-21postgres23:32:570
1847299140,10cyclictest4240-21rm00:22:190
1847299140,10cyclictest27942-21cpu22:30:110
1847299140,10cyclictest26567-21ssh21:53:340
1847299140,10cyclictest18278-21sh00:12:020
920939130,2EcMasterDemoSyn15663-21chrt22:59:085
880299130,11tDemoTimingTask17739-21chrt22:24:445
814499131,10tDemoTimingTask10455-21taskset00:07:525
407029130,0tAtEmLog_00-21swapper/523:51:025
2732499130,11tDemoTimingTask768-21chrt23:45:005
2630199131,10tDemoTimingTask28765-21taskset00:18:065
2354199130,10tDemoTimingTask32682-21chrt21:39:105
1894429130,3tAtEmLog_021904-21chrt23:02:095
1849199133,8cyclictest23935-21/usr/sbin/munin19:20:134
1849199131,9cyclictest4917-21sh00:05:084
1849199130,9cyclictest9022-21grep22:55:154
1849199130,9cyclictest780-21runrttasks20:40:064
1849199130,9cyclictest716-21snmpd19:15:034
1849199130,9cyclictest7005-21ssh21:25:024
1849199130,9cyclictest6419-21perl19:50:134
1849199130,9cyclictest393-21sh22:15:014
1849199130,9cyclictest30941-21df_inode19:35:124
1849199130,9cyclictest30941-21df_inode19:35:124
1849199130,9cyclictest29275-21/usr/sbin/munin21:55:204
1849199130,9cyclictest28989-21kernelversion19:30:174
1849199130,9cyclictest2695-21taskset20:50:054
1849199130,9cyclictest26261-21ssh23:05:024
1849199130,9cyclictest26182-21df_inode19:25:144
1849199130,9cyclictest25919-21open_files23:40:184
1849199130,9cyclictest22964-21/usr/sbin/munin00:15:144
1849199130,9cyclictest22377-21/usr/sbin/munin20:25:124
1849199130,9cyclictest20085-21sh21:50:084
1849199130,9cyclictest18541-21ssh22:25:034
1849199130,9cyclictest1774-21chrt20:46:174
1849199130,9cyclictest13586-21ssh22:40:114
1849199130,9cyclictest12455-21aten2_r5power_c21:10:114
1849199130,10cyclictest5914-21/usr/sbin/munin22:00:194
1849199130,10cyclictest27328-21taskset21:35:264
1849199130,10cyclictest19194-21sed00:30:224
1848799130,9cyclictest845-21/usr/sbin/munin19:40:183
1848799130,9cyclictest7484-21/usr/sbin/munin21:00:233
1848799130,9cyclictest30486-21ssh23:43:063
1848799130,9cyclictest29810-21/usr/sbin/munin20:40:183
1848799130,9cyclictest28806-21fw_packets19:30:153
1848799130,9cyclictest27525-21cpu20:35:123
1848799130,9cyclictest23471-21/usr/sbin/munin19:20:123
1848799130,9cyclictest21098-21runrttasks19:15:113
1848799130,9cyclictest18908-21cpuspeed19:10:113
1848799130,9cyclictest15485-21sh23:35:033
1848799130,10cyclictest8570-21/usr/sbin/munin00:25:253
1848799130,10cyclictest7065-21systemctl19:50:193
1848799130,10cyclictest30685-21awk21:55:193
1848799130,10cyclictest28606-21cpuspeed00:00:123
1848799130,10cyclictest21070-21ssh23:01:343
1848799130,10cyclictest15367-21runrttasks21:11:113
1848299131,7cyclictest24429-21apt-get20:30:012
1848299130,9cyclictest845-21/usr/sbin/munin19:40:122
1848299130,9cyclictest8425-21sh00:25:042
1848299130,9cyclictest326-21systemd-journal20:21:362
1848299130,9cyclictest29188-21runrttasks20:36:412
1848299130,9cyclictest28231-21/usr/sbin/munin19:30:132
1848299130,9cyclictest27735-21open_files23:05:172
1848299130,9cyclictest24680-21/usr/sbin/munin23:40:122
1848299130,9cyclictest23816-21sh22:10:032
1848299130,9cyclictest21474-21grep21:15:122
1848299130,9cyclictest19046-21ssh23:55:022
1848299130,9cyclictest19046-21ssh23:55:012
1848299130,9cyclictest18495-21sh22:25:012
1848299130,9cyclictest15283-21munin-node20:10:112
1848299130,9cyclictest10232-21fschecks_time22:20:142
1848299130,10cyclictest780-21runrttasks21:00:352
1848299130,10cyclictest716-21snmpd19:35:372
1848299130,10cyclictest716-21snmpd19:35:372
1848299130,10cyclictest6038-21head20:55:182
1848299130,10cyclictest28827-21/usr/sbin/munin00:00:132
1848299130,10cyclictest1864-21runrttasks20:47:322
1847899131,9cyclictest21946-21fschecks_time21:15:141
1847899131,9cyclictest20850-21/usr/sbin/munin20:20:171
1847899130,9cyclictest9693-21/usr/sbin/munin22:20:141
1847899130,9cyclictest8391-21/usr/sbin/munin22:55:241
1847899130,9cyclictest7950-21sh22:00:281
1847899130,9cyclictest7102-21ssh21:25:071
1847899130,9cyclictest3496-21/usr/sbin/munin19:45:131
1847899130,9cyclictest32465-21/usr/sbin/munin20:45:141
1847899130,9cyclictest32007-21/usr/sbin/munin00:20:131
1847899130,9cyclictest31456-21/usr/sbin/munin22:50:151
1847899130,9cyclictest3055-21/usr/sbin/munin23:10:141
1847899130,9cyclictest28231-21/usr/sbin/munin19:30:191
1847899130,9cyclictest22793-21ssh00:15:031
1847899130,9cyclictest20995-21sh23:20:041
1847899130,9cyclictest1121-21sh23:45:031
1847899130,9cyclictest10582-21interrupts21:05:171
1847899130,9cyclictest10582-21dpkg20:00:111
1847899130,10cyclictest780-21runrttasks23:26:131
1847899130,10cyclictest7763-21runrttasks19:53:121
1847899130,10cyclictest25115-21hostname20:30:131
1847899130,10cyclictest2023-21grep19:40:201
1847899130,10cyclictest19589-21sshd20:18:361
1847299131,9cyclictest780-21runrttasks20:31:190
1847299131,9cyclictest7388-21unixbench_multi19:50:230
1847299130,9cyclictest5157-21aten2_r5power_v20:55:130
1847299130,9cyclictest3058-21df_inode20:50:120
1847299130,9cyclictest25397-21chrt19:23:250
1847299130,9cyclictest2101-21runrttasks19:40:200
1847299130,9cyclictest18771-21proc_pri20:15:200
1847299130,7cyclictest17561-21cat20:15:010
1847299130,7cyclictest174-1kworker/0:1H+kblockd20:22:190
1847299130,6cyclictest6334-21ssh22:00:130
1847299130,6cyclictest12190-21grep20:00:240
1847299130,11cyclictest5138-21/usr/sbin/munin19:45:250
1847299130,10cyclictest30980-21/usr/sbin/munin20:40:190
1847299130,10cyclictest26939-21proc_pri19:25:200
947829120,3tAtEmLog_010563-21turbostat21:45:005
407199120,10tDemoTimingTask6125-21taskset23:47:255
3148199123,7tDemoTimingTask4455-21sleep00:05:015
268599122,7tDemoTimingTask5163-21chrt19:45:355
1849199120,9cyclictest9846-21users19:55:234
1849199120,9cyclictest780-21runrttasks20:17:404
1849199120,9cyclictest5453-21fschecks_count20:55:154
1849199120,9cyclictest4252-21irqstats19:45:174
1849199120,7cyclictest18506-21latency_hist19:10:004
1848799124,6cyclictest23512-21processes20:25:193
1848799120,9cyclictest13352-21fschecks_count20:05:143
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional