You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-15 - 08:02
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Tue Sep 15, 2026 00:44:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
148132650,0sleep10-21swapper/121:49:131
1891599200,6cyclictest2790150latency_hist00:25:003
1891599190,9cyclictest9904-21sh22:23:103
1891599190,9cyclictest26337-21sh22:50:273
1891599190,9cyclictest17847-21sh22:27:353
1891599190,8cyclictest19786-21sh23:42:423
319312180,0sleep40-21swapper/421:21:234
1891599189,8cyclictest22859-21cut22:30:193
1891599185,6cyclictest683-21dbus-daemon00:05:193
1891599184,6cyclictest27381-21mailstats19:25:203
1891599181,10cyclictest5126-21runrttasks19:47:433
1891599181,10cyclictest10241-21ssh22:05:073
1891599180,9cyclictest8955-21sh00:32:083
1891599180,9cyclictest8060-21latency_hist21:05:003
1891599180,9cyclictest3132-21ssh22:55:453
1891599180,9cyclictest22039-21taskset22:48:443
1891599180,9cyclictest2141-21sendmail_mailst20:50:193
1891599180,9cyclictest18968-21latency_hist19:10:013
1891599180,9cyclictest17718-21runrttasks00:18:543
1891599180,9cyclictest14111-21cpuspeed_turbos21:30:153
1891599180,9cyclictest12719-21sh21:10:253
1891599180,8cyclictest2954-21fschecks_time00:10:153
1891599180,8cyclictest2487-21diskmemload23:50:563
1891599180,8cyclictest10324-21sh23:55:233
1891199180,14cyclictest24841-21sh22:31:191
1890899185,9cyclictest2709-21sh22:37:230
1890899180,10cyclictest13378-21sh21:10:430
1891599175,5cyclictest22658-21grep19:15:193
1891599174,6cyclictest29446-21cat23:30:003
1891599174,6cyclictest25178-21expr19:20:233
1891599174,6cyclictest20825-21find20:20:223
1891599173,6cyclictest14652-21latency_hist20:10:003
1891599171,9cyclictest28607-21latency_hist20:40:013
1891599171,7cyclictest2608850latency_hist20:35:003
1891599170,9cyclictest9001-21sh22:04:253
1891599170,9cyclictest774-21runrttasks21:54:043
1891599170,9cyclictest774-21runrttasks21:27:113
1891599170,9cyclictest774-21runrttasks19:50:293
1891599170,9cyclictest5910-21sh21:44:073
1891599170,9cyclictest3812-21sh22:38:123
1891599170,9cyclictest32477-21ssh23:13:053
1891599170,9cyclictest32477-21ssh23:13:043
1891599170,9cyclictest32383-21ssh00:26:553
1891599170,9cyclictest30442-21runrttasks19:30:363
1891599170,9cyclictest23581-21sh21:16:453
1891599170,9cyclictest1457-21sh21:22:483
1891599170,9cyclictest13747-21sh00:35:143
1891599170,9cyclictest10205-21diskmemload23:05:343
1891599170,8cyclictest9659-21runrttasks19:56:423
1891599170,8cyclictest29731-21apt-get23:30:123
1891599170,8cyclictest26441-21/usr/sbin/munin21:55:193
1891599170,8cyclictest24762-21sh00:04:283
1891599170,8cyclictest23566-21aten2_r5power_p23:45:133
1891599170,8cyclictest11696-21sh22:42:323
1891599170,10cyclictest8319-21sh23:35:413
1891599170,10cyclictest6177-21ssh23:15:553
1891599170,10cyclictest28931-21grep22:15:153
1891599170,10cyclictest22905-21df21:35:123
1891599170,10cyclictest18990-21ssh22:10:083
1891599170,10cyclictest13624-21ssh21:48:203
1891599170,10cyclictest13523-21awk23:20:213
1891599170,10cyclictest13523-21awk23:20:213
1891499175,9cyclictest28889-21ssh23:47:572
1890899170,9cyclictest711-21snmpd23:31:480
1890899170,9cyclictest31735-21sh21:21:140
1890899170,9cyclictest31057-21sh21:58:150
1890899170,9cyclictest23270-21sh23:07:450
1890899170,9cyclictest1602-21sh00:28:070
1890899170,14cyclictest7316-21sh22:21:160
1892099164,8cyclictest32007-21cat19:35:164
1891599164,6cyclictest20425-21sensors_fan19:10:203
1891599163,6cyclictest31317-21cpuspeed_turbos19:35:113
1891599161,9cyclictest23526-21taskset20:26:433
1891599160,8cyclictest11280-21unixbench_multi23:00:253
1891599160,10cyclictest8198-21/usr/sbin/munin21:05:243
1891199160,13cyclictest21741-21sh22:48:311
1890899168,6cyclictest22319-21grep23:25:200
1890899165,8cyclictest6679-21sh21:44:410
1890899164,9cyclictest21583-21sh21:52:470
1890899160,9cyclictest774-21runrttasks20:48:010
1890899160,9cyclictest774-21runrttasks20:01:180
1890899160,8cyclictest774-21runrttasks20:30:480
1890899160,13cyclictest774-21runrttasks21:26:260
1890899160,10cyclictest103-1kworker/0:1H+kblockd00:30:160
1892099158,5cyclictest16704-40mandb00:00:014
18920991511,3cyclictest1-21systemd22:30:004
1891599154,8cyclictest32113-21ntpq20:45:183
1891599154,6cyclictest3819-21cut20:55:123
1891599154,5cyclictest12123-21sshd20:03:373
1891599153,6cyclictest3098-21latency_hist19:45:003
1891599153,6cyclictest1-21systemd20:15:203
1891599150,9cyclictest14839-21/usr/sbin/munin20:10:153
1891499158,6cyclictest19905-21tr21:15:132
1891499153,8cyclictest4376-21open_files19:45:182
1891499151,10cyclictest17831-21sh00:37:152
1891499150,11cyclictest13115-21ssh21:29:552
1891499150,10cyclictest10587-21df20:00:152
1891199157,6cyclictest24304-21sed21:35:231
1891199157,6cyclictest11470-21mailstats20:00:211
1891199151,10cyclictest9311-21ssh00:32:241
1891199151,10cyclictest7719-21ssh23:54:481
1891199151,10cyclictest30684-21ssh23:49:161
1891199151,10cyclictest20195-21ssh21:51:451
1891199151,10cyclictest19249-21/usr/sbin/munin19:10:111
1891199151,10cyclictest16768-21ssh00:18:141
1891199150,5cyclictest21241-21ssh00:20:221
1891199150,10cyclictest28447-21latency_hist20:40:011
1890899156,7cyclictest3724-21sh00:10:200
1890899156,7cyclictest21660-21/usr/sbin/munin00:20:260
1890899155,8cyclictest13721-21/usr/sbin/munin00:35:140
1890899154,8cyclictest728-21lldpd22:14:440
1890899153,9cyclictest21972-21wc22:30:150
1890899151,10cyclictest29502-21ssh22:52:440
1890899151,10cyclictest19404-21sh00:00:300
1890899150,8cyclictest19302-21latency_hist00:19:590
1890899150,7cyclictest15673-21sh22:26:000
1892099144,8cyclictest26386-21/usr/sbin/munin19:25:134
1892099141,9cyclictest7911-21/usr/sbin/munin19:55:254
1892099141,9cyclictest30811-21rm21:40:004
1892099141,9cyclictest27865-21ssh00:24:584
1892099141,9cyclictest22494-21runrttasks21:15:584
1892099141,9cyclictest16941-21fschecks_count21:50:144
1892099140,10cyclictest774-21runrttasks21:56:054
1892099140,10cyclictest7697-21sh22:59:074
1892099140,10cyclictest7541-21sh21:45:054
1892099140,10cyclictest7326-21ssh23:54:304
1892099140,10cyclictest3944-21sh22:00:434
1892099140,10cyclictest3725-21runrttasks23:33:444
1892099140,10cyclictest29955-21idleruntime-cro22:34:594
1892099140,10cyclictest28773-21/usr/sbin/munin19:30:184
1892099140,10cyclictest26045-21/usr/sbin/munin00:05:194
1892099140,10cyclictest22970-21chrt23:25:274
1892099140,10cyclictest22758-21cut20:25:184
1892099140,10cyclictest20472-21sh00:39:134
1892099140,10cyclictest16477-21cat23:40:234
1892099140,10cyclictest16337-21sh23:22:004
1892099140,10cyclictest16337-21sh23:21:594
1892099140,10cyclictest16046-21ssh22:08:104
1892099140,10cyclictest12648-21timerandwakeup00:15:234
1892099140,10cyclictest11033-21ssh22:42:034
1891599140,7cyclictest30745-21runrttasks20:44:483
1891499145,7cyclictest18740-21/usr/sbin/munin23:05:132
1891499141,9cyclictest8256-21sh22:59:322
1891499141,9cyclictest5963-21df_inode19:50:132
1891499141,9cyclictest4153-21diskmemload22:20:082
1891499141,9cyclictest2990-21apt-config23:15:012
1891499141,9cyclictest2990-21apt-config23:15:012
1891499141,9cyclictest29736-21ssh21:57:182
1891499141,9cyclictest28531-21ssh21:20:052
1891499141,9cyclictest22446-21sh22:11:282
1891499141,9cyclictest16823-21/usr/sbin/munin21:50:132
1891499141,9cyclictest14524-21ssh23:40:022
1891499141,9cyclictest10961-21runrttasks21:10:072
1891499141,10cyclictest9747-21runrttasks21:45:302
1891499141,10cyclictest2255-21/usr/sbin/munin19:40:232
1891499140,12cyclictest4664-21netstat23:15:152
1891499140,10cyclictest989-21wget20:50:122
1891499140,10cyclictest9445-21/usr/sbin/munin23:00:202
1891499140,10cyclictest924-21ssh21:40:262
1891499140,10cyclictest880-21sort19:40:002
1891499140,10cyclictest8338-21sh23:35:412
1891499140,10cyclictest774-21runrttasks22:47:112
1891499140,10cyclictest5008-21sh22:01:292
1891499140,10cyclictest3289-21sh23:33:252
1891499140,10cyclictest32225-21sh22:17:102
1891499140,10cyclictest32052-21rm23:50:032
1891499140,10cyclictest31571-21sh00:26:182
1891499140,10cyclictest30292-21sh22:35:032
1891499140,10cyclictest28137-21ssh22:51:442
1891499140,10cyclictest27329-21processes00:05:192
1891499140,10cyclictest25903-21ssh21:36:282
1891499140,10cyclictest21600-21wget19:15:142
1891499140,10cyclictest20917-21sh23:25:092
1891499140,10cyclictest19927-21interrupts19:10:172
1891499140,10cyclictest19568-21sh00:20:022
1891499140,10cyclictest19470-21seq20:20:092
1891499140,10cyclictest17063-21sh21:31:252
1891199141,9cyclictest4613-21ssh22:01:131
1891199141,9cyclictest29245-21sh22:52:331
1891199141,9cyclictest18966-21if_enp6s023:05:151
1891199141,9cyclictest12628-21/usr/sbin/munin20:05:131
1891199141,10cyclictest31351-21timerandwakeup23:30:241
1891199140,10cyclictest8683-21ssh22:22:171
1891199140,10cyclictest790-21sort20:50:011
1891199140,10cyclictest7331-21ssh00:12:421
1891199140,10cyclictest5812-21ssh22:57:451
1891199140,10cyclictest5078-21runrttasks19:47:031
1891199140,10cyclictest3484-21ssh21:42:211
1891199140,10cyclictest31358-21ssh21:20:581
1891199140,10cyclictest3120-21ssh22:37:411
1891199140,10cyclictest28858-21sh23:10:251
1891199140,10cyclictest28858-21sh23:10:251
1891199140,10cyclictest27799-21ssh22:15:071
1891199140,10cyclictest26071-21cat00:05:131
1891199140,10cyclictest24235-21ssh23:26:241
1891199140,10cyclictest22636-21ssh22:11:361
1891199140,10cyclictest21522-21ssh00:39:591
1891199140,10cyclictest21485-21/usr/sbin/munin19:15:201
1891199140,10cyclictest2139-21sh00:28:311
1891199140,10cyclictest20577-21ssh00:01:221
1891199140,10cyclictest19581-21ssh21:15:021
1891199140,10cyclictest17079-21sh23:40:441
1891199140,10cyclictest16327-21sh23:22:001
1891199140,10cyclictest16327-21sh23:21:591
1891199140,10cyclictest14606-21ssh21:11:351
1891199140,10cyclictest14023-21rm23:39:531
1891199140,10cyclictest13900-21cut21:30:131
1891199140,10cyclictest11350-21ssh23:56:041
1891199140,10cyclictest11225-21kernelversion22:05:181
1891199140,10cyclictest10989-21sh22:42:011
1891199140,10cyclictest10097-21sh21:27:441
1890899146,6cyclictest7385-21fschecks_count22:40:140
1890899141,9cyclictest774-21runrttasks22:17:050
1890899141,9cyclictest26674-21sh00:05:150
1890899141,10cyclictest29751-21ssh23:11:050
1890899141,10cyclictest29751-21ssh23:11:040
1890899141,10cyclictest28184-21runrttasks20:36:370
1890899140,8cyclictest20780-21sh21:15:170
1890899140,7cyclictest23637-21needreboot21:35:170
1890899140,7cyclictest2250-21fschecks_time22:00:150
1890899140,12cyclictest15367-21fschecks_time23:40:150
1890899140,10cyclictest9278-21sh23:55:150
1890899140,10cyclictest774-21runrttasks20:55:050
1890899140,10cyclictest774-21runrttasks19:39:210
1890899140,10cyclictest6808-21ssh23:54:080
1890899140,10cyclictest6762-21sh22:58:270
1890899140,10cyclictest6669-21kernelversion21:00:190
1890899140,10cyclictest6655-21fw_packets23:35:140
1890899140,10cyclictest6625-21sh23:16:150
1890899140,10cyclictest24472-21missed_timers23:45:170
1890899140,10cyclictest19240-21cat20:20:000
1890899140,10cyclictest17983-21sh22:45:450
1890899140,10cyclictest15158-21mailstats21:30:200
1890899140,10cyclictest14279-21vmstat23:20:290
1890899140,10cyclictest14279-21vmstat23:20:280
1890899140,10cyclictest10794-21awk22:05:150
1890899140,10cyclictest10103-21ssh21:45:450
1892099132,8cyclictest28720-21unixbench_multi23:10:234
1892099132,8cyclictest28720-21unixbench_multi23:10:224
1892099132,8cyclictest24931-21grep19:20:194
1892099132,8cyclictest18034-21missed_timers20:15:174
1892099130,9cyclictest9279-21ssh23:00:044
1892099130,9cyclictest8198-21/usr/sbin/munin21:05:194
1892099130,9cyclictest774-21runrttasks22:15:074
1892099130,9cyclictest774-21runrttasks20:40:094
1892099130,9cyclictest774-21runrttasks19:40:094
1892099130,9cyclictest7140-21sh00:30:474
1892099130,9cyclictest6222-21sh22:20:274
1892099130,9cyclictest6047-21cpu21:00:144
1892099130,9cyclictest5843-21sh00:11:364
1892099130,9cyclictest5813-21ssh23:35:044
1892099130,9cyclictest5607-21apt-get19:50:114
1892099130,9cyclictest5040-21runrttasks19:46:354
1892099130,9cyclictest4799-21ssh21:25:024
1892099130,9cyclictest3501-21aten2_r5power_c23:15:094
1892099130,9cyclictest31164-21ssh21:40:014
1892099130,9cyclictest28412-21/usr/sbin/munin00:25:134
1892099130,9cyclictest27393-21missed_timers20:35:194
1892099130,9cyclictest25603-21sh23:45:354
1892099130,9cyclictest24082-21/usr/sbin/munin20:30:254
1892099130,9cyclictest20303-21ssh23:05:344
1892099130,9cyclictest19719-21grep22:10:154
1892099130,9cyclictest19180-21runrttasks19:10:074
1892099130,9cyclictest16566-21runrttasks20:11:284
1892099130,9cyclictest15671-21aten2_r5power_p22:45:114
1892099130,9cyclictest10748-21apt-key21:10:004
1892099130,9cyclictest10228-21runrttasks20:00:064
1892099130,10cyclictest774-21runrttasks19:19:344
1892099130,10cyclictest26236-21rm22:50:244
1892099130,10cyclictest2579-21ssh22:37:184
1892099130,10cyclictest17478-21wget00:00:134
1892099130,10cyclictest14070-21tr21:30:144
1891499138,4cyclictest15215-21fschecks_count20:10:162
1891499134,7cyclictest13625-21tr22:25:132
1891499130,9cyclictest9359-21rm22:40:492
1891499130,9cyclictest8591-21fschecks_count21:05:132
1891499130,9cyclictest7911-21/usr/sbin/munin19:55:152
1891499130,9cyclictest7792-21sh00:31:172
1891499130,9cyclictest774-21runrttasks20:30:042
1891499130,9cyclictest774-21runrttasks20:05:052
1891499130,9cyclictest7158-21taskset21:00:242
1891499130,9cyclictest3531-21gpgconf20:55:002
1891499130,9cyclictest31163-21aten2_r5power_v20:45:122
1891499130,9cyclictest29186-21fschecks_count20:40:162
1891499130,9cyclictest29125-21df19:30:132
1891499130,9cyclictest281-21jbd2/md0-819:20:032
1891499130,9cyclictest27195-21irqstats20:35:192
1891499130,9cyclictest26115-21/usr/sbin/munin19:25:132
1891499130,9cyclictest23277-21timerwakeupswit20:25:232
1891499130,9cyclictest21551-21ssh22:30:042
1891499130,9cyclictest19049-21latency_hist19:10:002
1891499130,9cyclictest17128-21taskset20:15:032
1891499130,9cyclictest16704-40mandb00:00:012
1891499130,9cyclictest11884-21latency00:15:152
1891499130,9cyclictest10952-21runrttasks23:55:462
1891499130,9cyclictest10242-21ssh22:05:082
1891499130,10cyclictest5699-21sh00:11:302
1891499130,10cyclictest12173-21ssh23:20:072
1891499130,10cyclictest12173-21ssh23:20:072
1891199132,8cyclictest14204-21grep22:25:181
1891199131,9cyclictest7569-21runrttasks21:00:391
1891199131,9cyclictest21449-21taskset20:24:471
1891199130,9cyclictest9248-21ssh23:00:031
1891199130,9cyclictest7911-21/usr/sbin/munin19:55:141
1891199130,9cyclictest774-21runrttasks21:07:361
1891199130,9cyclictest734-21sshd20:57:131
1891199130,9cyclictest5604-21/usr/sbin/munin19:50:121
1891199130,9cyclictest4969-21ssh23:15:191
1891199130,9cyclictest32325-21taskset19:35:191
1891199130,9cyclictest28773-21/usr/sbin/munin19:30:121
1891199130,9cyclictest26115-21/usr/sbin/munin19:25:201
1891199130,9cyclictest24963-21ssh21:55:021
1891199130,9cyclictest24082-21/usr/sbin/munin20:30:151
1891199130,9cyclictest23809-21runrttasks19:20:091
1891199130,9cyclictest23552-21runrttasks20:27:041
1891199130,9cyclictest2211-21sendmail_mailtr19:40:221
1891199130,9cyclictest17340-21cpuspeed_turbos20:15:131
1891199130,9cyclictest16771-21taskset20:14:141
1890899135,7cyclictest22197-21/usr/sbin/munin20:25:130
1890899135,6cyclictest321-21systemd-journal19:30:360
1890899135,6cyclictest12009-21taskset23:00:530
1890899131,9cyclictest774-21runrttasks19:10:050
1890899131,9cyclictest7485-21taskset19:53:270
1890899130,9cyclictest9712-21/usr/sbin/munin21:05:220
1890899130,9cyclictest30450-21runrttasks20:40:480
1890899130,9cyclictest28139-21taskset19:29:420
1890899130,9cyclictest21339-21runrttasks20:23:170
1890899130,7cyclictest103-1kworker/0:1H+kblockd19:43:430
1890899130,7cyclictest103-1kworker/0:1H+kblockd19:15:020
1890899130,6cyclictest1313-21/usr/sbin/munin20:50:120
1890899130,10cyclictest4981-21chrt19:45:430
1890899130,10cyclictest24793-21head19:20:180
1890899130,10cyclictest14870-21cut20:10:130
1890899130,10cyclictest13594-21ntp_kernel_pll_20:05:200
1890899130,10cyclictest103-1kworker/0:1H+kblockd19:55:260
1892099120,9cyclictest955-21/usr/sbin/munin20:50:194
1892099120,9cyclictest3549-21sh20:55:004
1892099120,9cyclictest20598-21processes20:20:184
1892099120,9cyclictest13608-21runrttasks20:05:194
1892099120,8cyclictest711-21snmpd20:45:094
1891199120,9cyclictest28782-21aten2_r5power_c20:40:141
1891199120,9cyclictest1007-21aten2_r5power_e20:50:111
84442110,1sleep50-21swapper/500:31:475
31532110,1sleep50-21swapper/523:51:285
202862110,1sleep50-21swapper/522:47:275
1892099110,8cyclictest18978-21latency_hist19:10:014
14932110,1sleep50-21swapper/500:28:045
144792110,1sleep50-21swapper/522:07:035
248812100,1sleep50-21swapper/521:17:425
1891199101,7cyclictest18871-21latency_hist19:10:001
1890899103,5cyclictest18996-21date19:10:000
17181290,1sleep50-21swapper/522:27:075
9990280,1sleep50-21swapper/521:07:175
11022280,0sleep50-21swapper/521:10:115
23370270,0sleep50-21swapper/519:18:335
6248263,1sleep50-21swapper/522:20:295
7093250,3sleep50-21swapper/521:25:315
5321250,1sleep50-21swapper/523:34:555
4340250,1sleep50-21swapper/521:24:565
2602250,3sleep50-21swapper/521:41:405
17482250,1sleep50-21swapper/523:04:555
7077240,1sleep50-21swapper/522:58:415
616240,1sleep50-21swapper/519:40:005
596240,1sleep50-21swapper/520:49:555
5500240,1sleep50-21swapper/523:35:025
3461240,2sleep50-21swapper/523:15:105
30751240,1sleep50-21swapper/520:44:555
30741241,1sleep50-21swapper/521:39:585
29154240,1sleep50-21swapper/523:30:005
27669240,2sleep50-21swapper/500:24:515
24626240,1sleep50-21swapper/521:55:015
24484240,2sleep50-21swapper/522:12:595
23673240,2sleep50-21swapper/521:54:195
21126240,2sleep50-21swapper/500:01:485
18665240,1sleep50-21swapper/519:07:245
1833240,1sleep50-21swapper/500:10:015
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional