You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-12 - 08:31
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackeslot2.osadl.org (updated Fri Dec 12, 2025 00:43:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
333904522240,3sleep30-21swapper/321:30:013
316921621590,2sleep33169219-21turbostat19:20:003
33693932970,1sleep13369397-21kthreadcore21:45:101
34057222430,1sleep00-21swapper/022:05:490
3160040993129,1cyclictest0-21swapper/200:30:022
3160039993128,2cyclictest3435186-21cstates22:25:011
34509282300,1sleep13450927-21ssh22:33:311
3160039993023,2cyclictest170550irq/121-eno120:05:011
3160038992724,2cyclictest0-21swapper/021:00:010
3160040992623,1cyclictest0-21swapper/200:00:012
3160038992421,2cyclictest3574816-21grep23:45:010
3160038992416,7cyclictest3206206-21systemd-run19:50:000
3160038992414,5cyclictest0-21swapper/023:20:020
316003899230,18cyclictest3592380-21latency_hist23:55:010
3160040992219,1cyclictest0-21swapper/223:25:002
3160040992219,1cyclictest0-21swapper/221:15:012
3160038992219,2cyclictest3632624-21sh00:25:010
3160038992213,5cyclictest3584110-21sh23:50:020
3160038992211,6cyclictest0-21swapper/021:30:000
3160040992117,1cyclictest0-21swapper/200:40:022
3160039992118,2cyclictest3409053-21munin-plugin-st22:10:011
3160039992118,2cyclictest3273175-21dump-pmu-power20:45:011
3160038992118,2cyclictest3166089-21latency_hist19:15:010
3160038992114,6cyclictest1652-1atopacctd20:32:210
3160038992110,6cyclictest0-21swapper/023:35:000
3160040992017,1cyclictest0-21swapper/222:50:002
3160039992018,1cyclictest3574878-21grep23:45:011
3160039992017,2cyclictest3391302-21cstates22:00:021
3160039992017,2cyclictest3364858-21kworker/u16:3-events_unbound22:50:001
3160039992017,2cyclictest3166731-21swap19:15:021
316003899209,6cyclictest0-21swapper/000:10:020
3160038992017,2cyclictest3188037-21cut19:35:000
316003899201,3cyclictest3303815-21munin-run21:10:010
3160040991916,1cyclictest0-21swapper/223:00:112
3160040991916,1cyclictest0-21swapper/222:40:012
3160040991916,1cyclictest0-21swapper/222:40:012
3160040991916,1cyclictest0-21swapper/222:25:002
3160040991916,1cyclictest0-21swapper/220:40:012
3160039991916,2cyclictest3632426-21cron00:25:011
3160039991916,2cyclictest3611618-21aten2.4-expect00:10:021
3160039991916,2cyclictest3583413-21apt-key23:50:001
3160039991916,2cyclictest3469811-21cstates22:45:001
3160039991916,2cyclictest3255322-21cpuspeed_turbos20:30:011
3160039991916,2cyclictest0-21swapper/119:10:011
3160039991915,3cyclictest3339265-21cpuspeed_turbos21:30:011
3160039991914,3cyclictest3550743-21kthreadcore23:30:061
316003899198,6cyclictest0-21swapper/022:20:020
3160038991917,1cyclictest3522240-21apt-config23:15:010
3160038991916,2cyclictest3605040-21latency_hist00:05:000
3160038991916,2cyclictest3598895-21aten2.4-expect00:00:020
3160038991916,2cyclictest3231203-21cstates20:10:010
3160038991916,2cyclictest3160096-21systemd-run19:10:010
3160038991915,2cyclictest0-21swapper/020:15:010
3160038991914,4cyclictest3224513-21grep20:05:010
316003899191,13cyclictest0-21swapper/021:15:530
302487291190,2phc2sys0-21swapper/321:56:003
302487291190,2phc2sys0-21swapper/300:26:283
316004099181,8cyclictest0-21swapper/221:50:012
3160040991816,1cyclictest0-21swapper/221:20:032
3160040991816,1cyclictest0-21swapper/220:25:022
3160040991815,1cyclictest0-21swapper/219:30:022
3160040991815,1cyclictest0-21swapper/219:25:002
3160039991815,2cyclictest3566570-21latency_hist23:40:031
3160039991815,2cyclictest3443387-21grep22:30:021
3160039991815,2cyclictest3212623-21cstates19:55:011
3160039991815,2cyclictest3168543-21missed_timers19:15:031
316003899189,4cyclictest3387924-21timerwakeupswit21:55:170
316003899188,5cyclictest0-21swapper/023:35:080
3160038991815,2cyclictest3461244-21sh22:40:020
3160038991815,2cyclictest3461244-21sh22:40:020
3160038991815,2cyclictest3448464-21sh22:30:140
3160038991815,2cyclictest0-21swapper/019:40:010
3160038991813,1cyclictest170550irq/121-eno123:25:280
302487291180,2phc2sys0-21swapper/323:13:023
302487291180,2phc2sys0-21swapper/300:17:103
835298170,12rtkit-daemon3160036-21cyclictest21:54:270
33547322170,2sleep30-21swapper/321:37:423
3160040991715,1cyclictest0-21swapper/223:30:022
3160040991715,1cyclictest0-21swapper/219:35:002
3160040991715,1cyclictest0-21swapper/219:15:012
3160040991714,1cyclictest0-21swapper/223:15:102
3160040991714,1cyclictest0-21swapper/223:00:012
3160040991714,1cyclictest0-21swapper/222:15:012
3160040991714,1cyclictest0-21swapper/222:05:002
3160040991714,1cyclictest0-21swapper/220:00:012
3160040991714,1cyclictest0-21swapper/200:10:012
3160039991714,2cyclictest3544507-21tr23:25:121
3160039991714,2cyclictest3504370-21aten_repower_vo23:05:011
3160039991714,2cyclictest3356373-21aten2.4-expect21:40:021
3160039991714,2cyclictest3307896-21kthreadcore21:10:091
3160039991714,2cyclictest3297857-21acpi21:05:031
3160039991714,2cyclictest3285631-21/usr/sbin/munin20:55:001
3160039991714,2cyclictest3237074-21cstates20:15:001
3160039991714,2cyclictest3182302-21cstates19:30:011
3160039991714,2cyclictest0-21swapper/122:20:001
3160039991714,2cyclictest0-21swapper/121:20:021
3160039991713,3cyclictest3642619-21kthreadcore00:30:101
3160039991713,3cyclictest3642619-21kthreadcore00:30:101
3160039991713,2cyclictest0-21swapper/121:45:011
316003899179,3cyclictest3303731-21diskmemload22:45:280
3160038991714,2cyclictest3512998-21aten_repower_cu23:10:020
3160038991713,3cyclictest3639823-21aten_repower_en00:30:020
3160038991713,3cyclictest3306391-21kthreadcore21:10:080
3160038991713,3cyclictest3224568-21kworker/u16:0+nfsiod22:59:550
3160038991712,4cyclictest3478975-21gltestperf22:50:060
316003899171,12cyclictest0-21swapper/021:20:410
3160038991710,3cyclictest3303731-21diskmemload22:44:590
302487291170,2phc2sys0-21swapper/323:29:053
302487291170,2phc2sys0-21swapper/323:22:003
302487291170,2phc2sys0-21swapper/322:49:023
302487291170,2phc2sys0-21swapper/322:01:213
835298160,2rtkit-daemon0-21swapper/121:22:401
316004099163,7cyclictest0-21swapper/221:40:012
3160040991614,1cyclictest0-21swapper/223:30:022
3160040991614,1cyclictest0-21swapper/222:00:022
3160040991614,1cyclictest0-21swapper/221:00:012
3160040991614,1cyclictest0-21swapper/219:10:012
3160040991613,1cyclictest0-21swapper/223:45:142
3160040991613,1cyclictest0-21swapper/223:15:012
3160040991613,1cyclictest0-21swapper/223:07:512
3160040991613,1cyclictest0-21swapper/221:10:012
3160040991613,1cyclictest0-21swapper/220:55:002
3160040991613,1cyclictest0-21swapper/220:10:022
3160040991613,1cyclictest0-21swapper/219:50:022
3160040991613,1cyclictest0-21swapper/200:15:012
3160040991612,2cyclictest0-21swapper/220:40:032
316003999168,3cyclictest0-21swapper/122:10:051
316003999168,3cyclictest0-21swapper/120:20:001
3160039991614,1cyclictest1371-21rpcbind00:39:121
3160039991613,2cyclictest3618391-21/usr/sbin/munin00:15:011
3160039991613,2cyclictest1635-21dbus-daemon19:40:021
3160039991613,2cyclictest0-21swapper/120:10:011
3160039991612,3cyclictest3623476-21phc2sys00:15:121
3160039991612,3cyclictest3224568-21kworker/u16:0+nfsiod21:51:561
3160039991610,2cyclictest3535700-21missed_timers23:20:121
316003899169,6cyclictest0-21swapper/021:45:010
316003899169,6cyclictest0-21swapper/021:30:140
316003899167,5cyclictest0-21swapper/022:10:070
316003899167,2cyclictest0-21swapper/023:00:070
316003899165,4cyclictest3279005-21sshd20:47:160
3160038991613,2cyclictest8351-21rtkit-daemon23:24:410
3160038991613,2cyclictest3642626-21sort00:30:100
3160038991613,2cyclictest3642626-21sort00:30:100
3160038991613,2cyclictest3200967-21gltestperf19:45:020
3160038991613,2cyclictest3176091-21latency_hist19:25:010
3160038991613,2cyclictest0-21swapper/020:40:020
316003899161,10cyclictest3285454-21latency_hist20:55:010
316003899160,8cyclictest3443022-21ssh22:29:560
302487291161,2phc2sys0-21swapper/322:05:473
302487291160,2phc2sys0-21swapper/321:45:453
302487291160,2phc2sys0-21swapper/320:25:073
316004099151,6cyclictest0-21swapper/220:30:012
3160040991513,1cyclictest0-21swapper/223:55:002
3160040991513,1cyclictest0-21swapper/221:20:042
3160040991513,1cyclictest0-21swapper/219:15:032
3160040991513,1cyclictest0-21swapper/200:25:022
3160040991513,1cyclictest0-21swapper/200:05:012
3160040991512,1cyclictest0-21swapper/221:55:022
3160040991512,1cyclictest0-21swapper/221:40:052
3160040991512,1cyclictest0-21swapper/221:00:032
3160040991512,1cyclictest0-21swapper/220:47:162
3160040991511,2cyclictest0-21swapper/200:20:022
316004099150,4cyclictest0-21swapper/219:40:012
316003999156,2cyclictest170550irq/121-eno122:54:591
3160039991512,2cyclictest3589022-21switchtime23:50:131
3160039991512,2cyclictest3522066-21cstates23:15:011
3160039991512,2cyclictest3460702-21cron22:40:011
3160039991512,2cyclictest3460702-21cron22:40:011
3160039991512,2cyclictest3183649-21kthreadcore19:30:051
3160039991511,3cyclictest3592724-21aten_repower_vo23:55:021
3160039991511,3cyclictest3213780-21kthreadcore19:55:051
3160039991511,3cyclictest3198228-21kthreadcore19:40:081
3160039991511,3cyclictest1652-1atopacctd00:00:091
3160039991511,3cyclictest1635-21dbus-daemon20:50:011
316003899157,4cyclictest3351035-21kthreadcore21:35:050
316003899157,4cyclictest0-21swapper/022:05:010
316003899157,2cyclictest0-21swapper/022:20:310
3160038991512,2cyclictest3297534-21cron21:05:000
3160038991512,2cyclictest3255045-21latency_hist20:30:020
3160038991512,2cyclictest1635-21dbus-daemon20:45:010
3160038991512,2cyclictest0-21swapper/000:40:010
3160038991511,3cyclictest3245804-21kthreadcore20:20:080
302487291159,2phc2sys0-21swapper/320:50:093
302487291150,2phc2sys0-21swapper/323:50:583
3160040991411,1cyclictest0-21swapper/223:42:522
3160040991411,1cyclictest0-21swapper/222:55:002
3160040991411,1cyclictest0-21swapper/222:30:132
3160040991411,1cyclictest0-21swapper/222:26:132
3160040991411,1cyclictest0-21swapper/221:25:052
3160040991411,1cyclictest0-21swapper/220:00:052
3160040991411,1cyclictest0-21swapper/219:45:012
316003999145,3cyclictest0-21swapper/122:55:081
3160039991411,2cyclictest3634090-21kthreadcore00:25:101
3160039991411,2cyclictest3524887-21kthreadcore23:15:071
3160039991411,2cyclictest3394366-21kthreadcore22:00:081
3160039991411,2cyclictest3340351-21irqrtprio21:30:061
3160039991410,3cyclictest3382329-21kworker/u16:2+nfsiod23:07:561
3160039991410,3cyclictest3256718-21kthreadcore20:30:061
316003899145,3cyclictest3181449-21sshd19:27:150
3160038991412,1cyclictest0-21swapper/020:00:010
3160038991411,2cyclictest3212197-21aten_repower_cu19:54:590
3160038991411,2cyclictest3160036-21cyclictest20:19:280
302487291141,6phc2sys0-21swapper/322:19:593
302487291140,3phc2sys0-21swapper/323:02:503
302487291140,2phc2sys0-21swapper/321:53:203
302487291140,2phc2sys0-21swapper/320:37:043
302487291140,2phc2sys0-21swapper/300:10:443
3160040991311,1cyclictest0-21swapper/223:35:092
3160040991311,1cyclictest0-21swapper/222:45:012
3160040991311,1cyclictest0-21swapper/222:10:012
3160040991310,1cyclictest0-21swapper/220:15:062
316003999139,3cyclictest3244460-21kthreadcore20:20:061
316003999131,4cyclictest2025-21snmpd19:46:361
3160039991310,2cyclictest3297701-21unin-run21:05:011
3160039991310,2cyclictest3290913-21unixbench-2d20:55:121
3160039991310,2cyclictest3265991-21missed_timers20:35:121
3160039991310,2cyclictest3170272-21idleruntime19:20:061
316003899134,4cyclictest3168773-21sshd19:15:160
3160038991311,1cyclictest0-21swapper/000:15:000
3160038991310,2cyclictest3366433-21kernelversion21:45:080
302487291131,5phc2sys0-21swapper/319:29:593
302487291131,3phc2sys0-21swapper/321:41:363
302487291131,3phc2sys0-21swapper/321:20:163
302487291130,4phc2sys0-21swapper/300:10:013
302487291130,3phc2sys0-21swapper/320:09:593
302487291130,2phc2sys0-21swapper/300:21:593
316004099129,1cyclictest0-21swapper/220:30:072
3160040991210,1cyclictest0-21swapper/222:15:572
3160040991210,1cyclictest0-21swapper/221:30:072
3160040991210,1cyclictest0-21swapper/220:10:072
3160040991210,1cyclictest0-21swapper/219:55:012
3160040991210,1cyclictest0-21swapper/200:30:072
3160040991210,1cyclictest0-21swapper/200:30:072
316003899121,5cyclictest3618297-21/usr/sbin/munin00:15:040
302487291121,3phc2sys0-21swapper/323:55:023
302487291120,2phc2sys0-21swapper/319:40:023
302487291120,2phc2sys0-21swapper/300:00:513
302487291114,3phc2sys0-21swapper/320:20:083
302487291111,2phc2sys0-21swapper/323:44:563
302487291111,2phc2sys0-21swapper/323:30:293
302487291110,4phc2sys0-21swapper/319:44:583
302487291110,3phc2sys0-21swapper/323:15:073
302487291110,3phc2sys0-21swapper/322:52:583
302487291110,3phc2sys0-21swapper/322:22:133
302487291110,2phc2sys0-21swapper/323:10:023
302487291110,2phc2sys0-21swapper/322:55:473
302487291110,2phc2sys0-21swapper/322:35:073
302487291110,2phc2sys0-21swapper/322:35:073
302487291110,2phc2sys0-21swapper/322:26:493
302487291110,2phc2sys0-21swapper/320:20:013
302487291110,2phc2sys0-21swapper/319:48:553
33122202100,2sleep30-21swapper/321:14:513
302487291103,2phc2sys0-21swapper/320:30:063
302487291101,3phc2sys0-21swapper/319:10:043
302487291101,2phc2sys0-21swapper/323:35:383
302487291101,2phc2sys0-21swapper/319:50:043
302487291101,2phc2sys0-21swapper/300:39:513
302487291100,7phc2sys0-21swapper/320:57:153
302487291100,3phc2sys0-21swapper/323:46:243
302487291100,3phc2sys0-21swapper/321:30:023
302487291100,3phc2sys0-21swapper/300:35:023
302487291100,3phc2sys0-21swapper/300:35:023
302487291100,2phc2sys0-21swapper/322:41:123
302487291100,2phc2sys0-21swapper/322:10:383
302487291100,2phc2sys0-21swapper/321:15:113
302487291100,2phc2sys0-21swapper/320:45:023
302487291100,2phc2sys0-21swapper/320:00:013
302487291100,2phc2sys0-21swapper/319:24:553
302487291100,1phc2sys0-21swapper/321:04:333
30248729191,2phc2sys0-21swapper/322:30:103
30248729191,2phc2sys0-21swapper/321:05:053
30248729190,3phc2sys0-21swapper/320:10:033
30248729190,2phc2sys0-21swapper/320:47:503
30248729190,2phc2sys0-21swapper/320:00:053
30248729190,2phc2sys0-21swapper/319:30:043
30248729180,2phc2sys0-21swapper/319:05:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional