You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-23 - 06:42
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackeslot2.osadl.org (updated Tue Dec 23, 2025 00:43:58)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
6689802860,2sleep30-21swapper/320:58:323
536220992620,5cyclictest889007-1atop00:00:010
536220992516,4cyclictest561125-21kthreadcore19:28:310
536225992320,2cyclictest829025-21systemd23:10:021
536225992320,2cyclictest0-21swapper/120:55:011
53622099220,2cyclictest542629-21munin-run19:15:010
53622099218,2cyclictest689481-21latency_hist21:15:010
536220992114,5cyclictest1286-21avahi-daemon23:30:020
536225992016,3cyclictest731079-21sendmail_mailqu21:48:361
536220992015,4cyclictest556607-21systemd-run19:25:010
536220992015,4cyclictest1-21systemd00:20:010
536220992014,4cyclictest797969-21systemd-run22:45:010
53622799198,6cyclictest0-21swapper/200:20:012
536227991917,1cyclictest0-21swapper/219:50:022
536227991916,1cyclictest0-21swapper/220:20:012
536225991916,2cyclictest1326-21systemd-logind21:45:011
53622099195,6cyclictest937714-21awk00:40:000
53622099192,7cyclictest641066-21turbostat20:35:000
536220991914,4cyclictest677606-21cut21:05:020
536220991914,4cyclictest586678-21perf19:50:000
536220991914,4cyclictest550823-21cut19:20:020
536220991913,5cyclictest931680-21idleruntime-cro00:35:000
536220991913,5cyclictest931680-21idleruntime-cro00:35:000
536220991912,6cyclictest823397-21tr23:08:270
53622099191,12cyclictest732213-21apt-get21:53:260
536227991815,1cyclictest0-21swapper/223:00:002
536225991815,2cyclictest842030-21fschecks_time23:23:291
536225991815,2cyclictest641322-21cut20:35:021
536225991815,2cyclictest586729-21apt-key19:50:001
536225991815,2cyclictest1290-21dbus-daemon00:15:011
53622099186,8cyclictest0-21swapper/021:36:440
53622099185,4cyclictest756266-21sshd22:13:210
53622099184,5cyclictest587476-21/usr/sbin/munin19:53:380
53622099184,5cyclictest587476-21/usr/sbin/munin19:53:380
53622099181,8cyclictest683515-21munin-run21:10:010
536220991813,4cyclictest755727-21perf22:10:000
536220991813,4cyclictest599225-21cut20:00:020
536220991813,4cyclictest257-21systemd-journal22:05:020
536220991812,5cyclictest864537-21timerandwakeup23:38:360
536220991812,5cyclictest785979-21latency_hist22:35:010
536220991812,5cyclictest615507-21kthreadcore20:13:330
536220991812,5cyclictest1327-21in:imuxsock00:25:000
536220991811,6cyclictest704741-21kthreadcore21:28:320
536220991811,6cyclictest704741-21kthreadcore21:28:320
536220991811,3cyclictest803553-21timerwakeupswit22:48:410
536220991811,2cyclictest858890-21sh23:35:010
536220991811,2cyclictest1290-21dbus-daemon23:53:360
536220991811,2cyclictest0-21swapper/022:00:020
536220991811,2cyclictest0-21swapper/000:15:010
53622099180,3cyclictest695503-21ls21:20:000
53622799179,3cyclictest0-21swapper/222:38:222
53622799173,9cyclictest0-21swapper/222:20:012
536227991714,1cyclictest0-21swapper/221:50:012
536225991715,1cyclictest707764-21/usr/sbin/munin21:30:011
536225991715,1cyclictest707764-21/usr/sbin/munin21:30:011
536225991714,2cyclictest895029-21cut00:05:011
536225991714,2cyclictest848185-21gltestperf23:28:271
536225991714,2cyclictest775690-21kthreadcore22:28:321
536225991714,2cyclictest536214-21cyclictest23:38:271
536225991714,2cyclictest536214-21cyclictest22:25:011
536225991714,2cyclictest1310-21smartd20:38:521
536225991713,3cyclictest1327-21in:imuxsock19:10:011
536225991713,3cyclictest1288-1atopacctd19:35:011
53622099177,3cyclictest0-21swapper/023:18:280
53622099174,5cyclictest925745-21cat00:30:000
53622099174,2cyclictest774394-21apt22:28:250
53622099173,6cyclictest829478-21aten2.4-expect23:13:260
53622099173,6cyclictest666049-21aten2.4-expect20:58:260
53622099173,6cyclictest617614-21aten2.4-expect20:18:240
53622099171,7cyclictest817810-21hddtemp_smartct23:03:290
53622099171,7cyclictest659144-21latency_hist20:50:010
536220991712,4cyclictest536214-21cyclictest20:25:020
536220991711,5cyclictest634695-21timerandwakeup20:28:350
536220991711,2cyclictest808063-21kthreadcore22:53:320
536220991711,2cyclictest663757-21kthreadcore20:53:340
536220991711,2cyclictest604502-21mailstats20:03:360
536220991711,2cyclictest536391-21munin-plugin-st19:10:020
536220991711,2cyclictest536214-21cyclictest20:08:370
536220991710,6cyclictest900505-21ptp4l00:08:340
536220991710,6cyclictest651234-21kthreadcore20:43:320
2902298170,4rtkit-daemon2016-21snmpd20:25:091
2649091170,3phc2sys0-21swapper/323:43:273
536227991613,1cyclictest0-21swapper/221:35:002
536227991613,1cyclictest0-21swapper/200:40:002
536227991611,3cyclictest0-21swapper/223:45:012
53622599161,7cyclictest877499-21apt-get23:53:241
536225991613,2cyclictest1326-21systemd-logind21:10:021
536225991612,3cyclictest598414-21sendmail_mailqu19:58:371
53622099169,3cyclictest842438-21irqcore23:23:310
53622099169,3cyclictest576949-21kthreadcore19:43:290
53622099168,3cyclictest720939-21tail21:43:260
53622099167,5cyclictest710814-21tr21:33:300
53622099166,5cyclictest641625-21sshd20:38:220
53622099163,2cyclictest491rcuog/223:43:280
53622099162,6cyclictest762424-21aten2.4-expect22:18:240
53622099162,5cyclictest569244-21head19:38:260
536220991610,5cyclictest727497-21kernelversion21:48:300
536220991610,2cyclictest890143-21fschecks_count00:03:290
536220991610,2cyclictest815836-21timerandwakeup22:58:380
536220991610,2cyclictest791984-21latency_hist22:40:010
536220991610,2cyclictest566782-21kthreadcore19:33:320
536220991610,2cyclictest1-21systemd21:20:220
53622099160,8cyclictest871463-21/usr/sbin/munin23:48:280
53622799152,7cyclictest0-21swapper/200:10:012
536227991512,1cyclictest0-21swapper/222:53:342
536227991512,1cyclictest0-21swapper/220:55:012
536227991512,1cyclictest0-21swapper/220:38:312
536227991512,1cyclictest0-21swapper/200:25:002
536227991512,1cyclictest0-21swapper/200:15:012
53622599155,5cyclictest603231-21kthreadcore20:03:321
536225991513,1cyclictest816600-21latency_hist23:00:011
536225991512,2cyclictest873224-21kthreadcore23:48:311
536225991512,2cyclictest853725-21cut23:33:261
536225991512,2cyclictest785836-21idleruntime-cro22:35:001
536225991512,2cyclictest701678-21munin-plugin-st21:25:011
536225991512,2cyclictest623278-21systemd-run20:20:021
536225991512,2cyclictest562652-21systemd-run19:30:011
536225991512,2cyclictest536214-21cyclictest19:38:521
536225991512,2cyclictest0-21swapper/122:00:021
536225991511,3cyclictest927562-21kthreadcore00:33:311
536225991511,3cyclictest927562-21kthreadcore00:33:311
536225991511,3cyclictest922280-21kthreadcore00:28:311
536225991511,3cyclictest711397-21kthreadcore21:33:311
536225991511,3cyclictest1-21systemd22:01:211
53622099159,2cyclictest768414-21aten_repower_fr22:23:270
2649091150,2phc2sys0-21swapper/323:49:553
53622799148,2cyclictest0-21swapper/222:08:242
536227991412,1cyclictest0-21swapper/220:43:262
536227991411,1cyclictest0-21swapper/223:33:332
536227991411,1cyclictest0-21swapper/222:48:352
536227991411,1cyclictest0-21swapper/219:13:312
53622599148,5cyclictest820691-21tr23:03:321
536225991411,2cyclictest834945-21systemd-run23:15:011
536225991411,2cyclictest718218-21kthreadcore21:38:311
536225991411,2cyclictest684215-21aten2.4-expect21:13:251
536225991411,2cyclictest653193-21cut20:45:011
536225991411,2cyclictest1326-21systemd-logind22:40:011
536225991411,2cyclictest1290-21dbus-daemon23:20:011
536225991411,2cyclictest0-21swapper/122:10:001
536225991411,2cyclictest0-21swapper/119:15:011
536225991410,3cyclictest915551-21kthreadcore00:23:321
536225991410,3cyclictest898366-21kthreadcore00:08:321
536225991410,3cyclictest657763-21kthreadcore20:48:311
536225991410,3cyclictest608772-21kthreadcore20:08:321
536225991410,3cyclictest590602-21kthreadcore19:53:311
536225991410,3cyclictest590602-21kthreadcore19:53:311
536225991410,3cyclictest548700-21kthreadcore19:18:311
53622799139,1cyclictest0-21swapper/223:08:252
53622799137,3cyclictest0-21swapper/200:03:262
536227991311,1cyclictest0-21swapper/223:25:012
536227991311,1cyclictest0-21swapper/222:05:022
536227991311,1cyclictest0-21swapper/220:45:572
536227991311,1cyclictest0-21swapper/219:43:292
536227991311,1cyclictest0-21swapper/219:15:032
536227991311,1cyclictest0-21swapper/200:28:312
536227991310,1cyclictest0-21swapper/223:55:012
536227991310,1cyclictest0-21swapper/223:13:302
536227991310,1cyclictest0-21swapper/221:45:012
53622799130,7cyclictest0-21swapper/222:00:012
53622599139,3cyclictest806761-21kthreadcore22:53:311
53622599139,3cyclictest677038-21switchtime21:03:361
53622599139,3cyclictest536214-21cyclictest19:43:291
53622599138,4cyclictest1-21systemd20:15:011
53622599136,2cyclictest134050irq/121-eno122:48:351
53622599135,4cyclictest0-21swapper/120:58:221
53622599133,4cyclictest762334-21apt-get22:18:231
53622599132,3cyclictest1996-21runrttasks23:44:411
536225991310,2cyclictest888634-21timerwakeupswit23:58:381
536225991310,2cyclictest757393-21irqrtprio22:13:291
536225991310,2cyclictest736266-21kthreadcore21:53:341
536225991310,2cyclictest690595-21sh21:18:261
536225991310,2cyclictest1327-21in:imuxsock22:41:301
536225991310,2cyclictest0-21swapper/100:40:011
2649091134,2phc2sys0-21swapper/323:53:343
2649091130,2phc2sys0-21swapper/323:10:023
2649091130,2phc2sys0-21swapper/320:42:263
53622799129,1cyclictest0-21swapper/223:48:322
53622799129,1cyclictest0-21swapper/223:26:562
53622799129,1cyclictest0-21swapper/222:43:242
53622799129,1cyclictest0-21swapper/221:38:312
53622799129,1cyclictest0-21swapper/221:28:092
53622799129,1cyclictest0-21swapper/221:28:092
53622799129,1cyclictest0-21swapper/221:17:552
53622799129,1cyclictest0-21swapper/221:00:222
53622799129,1cyclictest0-21swapper/220:55:232
53622799129,1cyclictest0-21swapper/220:23:252
53622799129,1cyclictest0-21swapper/220:03:372
53622799129,1cyclictest0-21swapper/219:23:332
53622799124,6cyclictest0-21swapper/222:13:242
53622799122,4cyclictest0-21swapper/220:30:012
53622799121,3cyclictest0-21swapper/220:00:012
536227991210,1cyclictest0-21swapper/223:40:022
536227991210,1cyclictest0-21swapper/223:20:022
536227991210,1cyclictest0-21swapper/222:23:302
536227991210,1cyclictest0-21swapper/219:53:252
536227991210,1cyclictest0-21swapper/219:53:252
53622599129,2cyclictest626444-21kthreadcore20:23:311
53622599129,2cyclictest552156-21irqcore19:23:311
2649091120,2phc2sys0-21swapper/323:11:253
2649091120,2phc2sys0-21swapper/321:59:243
2649091120,1phc2sys0-21swapper/320:48:243
53622799119,1cyclictest0-21swapper/223:58:412
53622799119,1cyclictest0-21swapper/223:00:192
53622799119,1cyclictest0-21swapper/221:50:412
53622799119,1cyclictest0-21swapper/221:22:012
53622799119,1cyclictest0-21swapper/220:31:502
53622799119,1cyclictest0-21swapper/220:14:262
53622799119,1cyclictest0-21swapper/220:05:132
53622799119,1cyclictest0-21swapper/219:28:212
53622799119,1cyclictest0-21swapper/200:31:272
53622799119,1cyclictest0-21swapper/200:31:272
53622799118,1cyclictest0-21swapper/219:37:342
53622799112,5cyclictest0-21swapper/219:10:012
53622799110,8cyclictest774305-21taskset22:27:402
53622599118,2cyclictest909216-21kthreadcore00:18:321
2649091113,2phc2sys0-21swapper/300:08:363
2649091111,3phc2sys0-21swapper/320:55:013
2649091111,2phc2sys0-21swapper/320:18:303
2649091111,2phc2sys0-21swapper/320:03:323
2649091111,2phc2sys0-21swapper/300:38:263
2649091110,2phc2sys0-21swapper/322:13:243
2649091110,2phc2sys0-21swapper/320:05:473
2649091110,1phc2sys0-21swapper/322:03:023
2649091110,1phc2sys0-21swapper/321:26:073
2649091110,1phc2sys0-21swapper/321:26:073
2649091110,1phc2sys0-21swapper/321:09:353
2649091110,1phc2sys0-21swapper/319:35:113
2649091110,1phc2sys0-21swapper/300:23:583
2649091110,1phc2sys0-21swapper/300:14:413
53622799108,1cyclictest0-21swapper/222:30:372
53622799108,1cyclictest0-21swapper/221:12:482
53622799108,1cyclictest0-21swapper/219:33:262
2649091102,2phc2sys0-21swapper/323:03:373
2649091101,2phc2sys0-21swapper/323:35:023
2649091101,2phc2sys0-21swapper/319:10:023
2649091101,2phc2sys0-21swapper/300:30:003
2649091100,2phc2sys0-21swapper/323:55:293
2649091100,1phc2sys0-21swapper/322:45:213
2649091100,1phc2sys0-21swapper/321:30:563
2649091100,1phc2sys0-21swapper/321:12:003
2649091100,1phc2sys0-21swapper/320:11:453
2649091100,1phc2sys0-21swapper/319:55:063
2649091100,1phc2sys0-21swapper/319:44:323
2649091100,1phc2sys0-21swapper/319:32:143
2649091100,1phc2sys0-21swapper/300:34:333
2649091100,1phc2sys0-21swapper/300:34:333
5362279997,1cyclictest0-21swapper/221:07:412
264909191,2phc2sys0-21swapper/320:23:313
264909190,2phc2sys0-21swapper/323:19:563
264909190,2phc2sys0-21swapper/322:34:563
264909190,2phc2sys0-21swapper/322:25:023
264909190,2phc2sys0-21swapper/321:39:563
264909190,2phc2sys0-21swapper/320:28:243
264909190,2phc2sys0-21swapper/319:53:303
264909190,2phc2sys0-21swapper/319:53:303
264909190,2phc2sys0-21swapper/319:28:253
264909190,2phc2sys0-21swapper/319:18:243
264909190,2phc2sys0-21swapper/300:20:023
264909190,2phc2sys0-21swapper/300:04:553
264909190,1phc2sys0-21swapper/322:20:013
264909190,1phc2sys0-21swapper/321:43:223
264909181,2phc2sys0-21swapper/322:26:503
264909181,2phc2sys0-21swapper/319:13:263
264909181,1phc2sys0-21swapper/323:23:283
264909181,1phc2sys0-21swapper/321:03:303
264909180,2phc2sys0-21swapper/323:38:273
264909180,2phc2sys0-21swapper/322:55:033
264909180,2phc2sys0-21swapper/322:53:273
264909180,2phc2sys0-21swapper/322:38:243
264909180,2phc2sys0-21swapper/321:53:283
264909180,2phc2sys0-21swapper/321:20:243
264909180,2phc2sys0-21swapper/321:18:333
264909180,2phc2sys0-21swapper/320:38:223
264909180,2phc2sys0-21swapper/320:33:253
264909180,1phc2sys0-21swapper/323:27:493
264909180,1phc2sys0-21swapper/322:40:293
264909180,1phc2sys0-21swapper/321:46:433
264909180,1phc2sys0-21swapper/319:48:253
264909171,2phc2sys0-21swapper/319:21:043
264909170,1phc2sys0-21swapper/322:05:143
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional