You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-03 - 17:22
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot8.osadl.org (updated Wed Dec 03, 2025 00:43:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
37242542570,2sleep2421rcuc/222:05:172
38513942410,2sleep1321rcuc/123:25:151
3479179992825,1cyclictest0-21swapper/322:05:003
3479179992320,1cyclictest0-21swapper/323:05:153
3479179992218,1cyclictest0-21swapper/322:45:023
3479179992118,1cyclictest0-21swapper/319:45:153
3479179992017,1cyclictest0-21swapper/319:10:183
347917999201,14cyclictest3500270-21turbostat19:25:003
347917999199,7cyclictest39069962sleep300:00:123
3479179991916,1cyclictest0-21swapper/321:40:213
3479179991916,1cyclictest0-21swapper/320:15:003
3479179991915,1cyclictest0-21swapper/322:50:013
347917999191,13cyclictest3556594-21taskset20:09:563
347917999191,13cyclictest3556594-21taskset20:09:563
347917999188,7cyclictest3777469-21sleep22:40:003
3479179991815,1cyclictest0-21swapper/321:27:213
347917999181,13cyclictest3963263-21turbostat00:35:003
347917999181,13cyclictest3938991-21turbostat00:20:003
347917999180,14cyclictest3712543-21turbostat22:00:013
347917999177,7cyclictest35888822sleep320:35:183
3479179991714,1cyclictest0-21swapper/322:50:173
3479179991714,1cyclictest0-21swapper/322:20:193
3479179991714,1cyclictest0-21swapper/321:30:193
3479179991714,1cyclictest0-21swapper/300:35:173
347917999171,13cyclictest3831857-21chrt23:10:423
347917999171,13cyclictest3513849-21taskset19:35:183
347917999171,12cyclictest3891298-21taskset23:50:173
347917999171,12cyclictest3843852-21taskset23:20:163
347917999171,12cyclictest3809509-21taskset22:59:563
347917999171,12cyclictest3726594-21taskset22:05:223
347917999171,12cyclictest3649090-21taskset21:20:173
347917999171,12cyclictest3624886-21taskset21:00:223
347917999171,12cyclictest3619255-21chrt20:56:533
347917999171,12cyclictest3500906-21taskset19:25:173
347917999170,14cyclictest3863749-21chrt23:30:223
38901392160,8sleep23890147-21ssh23:49:052
347917999167,6cyclictest37683032sleep322:32:243
347917999161,9cyclictest3688367-21sleep21:49:553
3479179991613,1cyclictest0-21swapper/323:45:173
3479179991613,1cyclictest0-21swapper/323:00:183
3479179991613,1cyclictest0-21swapper/322:10:163
3479179991613,1cyclictest0-21swapper/322:10:163
3479179991613,1cyclictest0-21swapper/300:25:183
3479179991613,1cyclictest0-21swapper/300:20:233
3479179991613,1cyclictest0-21swapper/300:10:163
347917999161,12cyclictest3872426-21taskset23:35:263
347917999161,12cyclictest3856444-21taskset23:25:543
347917999161,12cyclictest3840551-21taskset23:17:033
347917999161,12cyclictest3745297-21sleep22:20:003
347917999161,12cyclictest3745297-21sleep22:20:003
347917999161,12cyclictest3702025-21chrt21:50:233
347917999161,12cyclictest3679804-21taskset21:38:533
347917999161,12cyclictest3640380-21taskset21:15:083
347917999161,12cyclictest3638348-21taskset21:10:513
347917999161,12cyclictest3600386-21chrt20:40:543
347917999161,12cyclictest3537594-21chrt19:51:573
347917999161,12cyclictest3512622-21chrt19:33:173
347917999161,11cyclictest3915541-21taskset00:05:163
347917999161,11cyclictest3519276-21chrt19:40:113
347917999160,13cyclictest3630333-21chrt21:05:183
347917999160,12cyclictest3581952-21turbostat20:30:003
3479179991512,1cyclictest0-21swapper/320:16:563
3479179991512,1cyclictest0-21swapper/319:57:243
347917999151,12cyclictest3550004-21taskset20:00:263
347917999151,11cyclictest3882518-21turbostat23:45:003
347917999151,11cyclictest3613066-21taskset20:52:523
347917999151,11cyclictest3606663-21taskset20:46:033
347917999151,11cyclictest3582221-21taskset20:30:123
347917999151,11cyclictest3490127-21taskset19:15:183
347917999150,12cyclictest3906678-21turbostat00:00:003
347917999150,12cyclictest3759392-21taskset22:25:253
36178082141,5sleep03618523-21sed20:55:180
35619682140,4sleep03562024-21ntp_states20:10:220
3479179991411,1cyclictest0-21swapper/320:20:173
147598140,10rtkit-daemon729-21lldpd00:11:101
37532822131,4sleep11-21systemd22:25:011
147598130,8rtkit-daemon3884382-21cat23:45:161
147598130,8rtkit-daemon3804806-21cut22:55:182
147598130,8rtkit-daemon3680059-21ssh21:39:302
38813962120,9sleep13881404-21ssh23:42:271
38799762120,8sleep03880060-21ssh23:40:220
37108072120,9sleep03710815-21ssh21:55:580
147598120,8rtkit-daemon3719084-21ssh22:00:511
147598120,8rtkit-daemon3662153-21ssh21:25:252
38587242111,7sleep03858781-21fschecks_count23:30:150
38355682110,8sleep03837475-21cut23:15:170
147598110,7rtkit-daemon3733305-21cut22:10:181
147598110,7rtkit-daemon3733305-21cut22:10:181
147598110,7rtkit-daemon295-21systemd-journal00:24:420
147598110,6rtkit-daemon3575012-21unixbench_singl20:20:252
147598110,4rtkit-daemon729-21lldpd21:17:492
147598110,2rtkit-daemon214-21plymouthd19:19:172
39677332100,7sleep03968580-21cat00:35:200
39635142101,5sleep1214-21plymouthd00:35:131
39135792100,7sleep03913587-21ssh00:02:140
38251922100,4sleep00-21swapper/023:09:040
36338362100,7sleep13635702-21cut21:10:181
36264492101,6sleep03627189-21cut21:05:160
35192792102,4sleep13519312-21apt-get19:40:141
147598100,6rtkit-daemon22110-21packagekitd00:34:330
147598100,6rtkit-daemon1540-21sendmail-mta23:09:471
147598100,3rtkit-daemon22110-21packagekitd22:29:232
147598100,2rtkit-daemon0-21swapper/122:08:061
147598100,1rtkit-daemon0-21swapper/221:23:332
147598100,1rtkit-daemon0-21swapper/122:39:311
147598100,1rtkit-daemon0-21swapper/000:29:220
3931433290,1sleep20-21swapper/200:15:142
3890897291,5sleep03891051-21df23:50:150
3825955291,4sleep13825992-21apt-get23:10:131
3810814290,6sleep03811792-21kthreadcore23:00:180
3754974290,6sleep13756016-21kthreadcore22:25:161
3736773290,6sleep23736781-21ssh22:14:352
3736773290,6sleep23736781-21ssh22:14:352
3721173291,4sleep03721207-21apt-get22:05:120
3719515293,3sleep014-21ksoftirqd/022:01:470
3702968290,6sleep03702976-21ssh21:51:330
3654894293,3sleep13654902-21ssh21:22:001
3650013290,6sleep03651949-21grep21:20:190
3638255291,2sleep00-21swapper/021:10:410
3619778291,4sleep23619811-21apt-get21:00:132
3612355290,6sleep13612412-21/usr/sbin/munin20:50:231
3607229291,4sleep03607262-21apt-get20:50:140
3600708290,6sleep01-21systemd20:45:010
3563158291,5sleep03563314-21/usr/sbin/munin20:15:150
3562025290,6sleep13562108-21/usr/sbin/munin20:10:231
3536865290,7sleep03536980-21awk19:50:220
34791799996,1cyclictest0-21swapper/319:10:003
14759890,5rtkit-daemon3815300-21sed23:00:231
14759890,5rtkit-daemon3785730-21ssh22:45:031
14759890,5rtkit-daemon295-21systemd-journal20:53:222
14759890,5rtkit-daemon22110-21packagekitd19:45:132
14759890,5rtkit-daemon214-21plymouthd21:50:332
14759890,4rtkit-daemon3678867-21ssh21:36:451
14759890,2rtkit-daemon214-21plymouthd21:33:412
14759890,1rtkit-daemon0-21swapper/223:38:012
3858536280,4sleep23858573-21apt-get23:30:132
3817917280,1sleep20-21swapper/223:05:132
3745602281,3sleep23745639-21apt-get22:20:122
3745253281,4sleep23745318-21munin-run22:20:002
3745253281,4sleep23745318-21munin-run22:20:002
3695264280,6sleep23695270-21ssh21:47:192
3689107280,6sleep03689772-21irqrtprio21:45:160
3687407280,3sleep10-21swapper/121:42:481
3583629281,4sleep03585539-21cut20:30:190
3582543281,4sleep23582685-21ps20:30:162
3569805280,5sleep13570308-21irqcore20:20:171
14759880,5rtkit-daemon1-21systemd22:40:491
14759880,4rtkit-daemon729-21lldpd21:40:322
14759880,4rtkit-daemon476-21wpa_supplicant19:11:462
14759880,4rtkit-daemon3704387-21ssh21:54:571
14759880,4rtkit-daemon3523115-21tr19:40:192
14759880,4rtkit-daemon3485788-21munin-node00:04:352
14759880,4rtkit-daemon3473400-21idleruntime19:05:172
14759880,4rtkit-daemon214-21plymouthd20:27:432
14759880,4rtkit-daemon1-21systemd21:07:022
14759880,3rtkit-daemon214-21plymouthd23:40:382
14759880,3rtkit-daemon214-21plymouthd23:14:250
14759880,3rtkit-daemon1540-21sendmail-mta19:55:212
14759880,1rtkit-daemon0-21swapper/223:16:562
14759880,1rtkit-daemon0-21swapper/222:51:462
14759880,1rtkit-daemon0-21swapper/220:58:532
14759880,1rtkit-daemon0-21swapper/219:25:252
14759880,1rtkit-daemon0-21swapper/123:22:201
3962961270,5sleep10-21swapper/100:34:251
3956873271,4sleep23957870-21grep00:30:172
3931210272,3sleep13905304-21kworker/u16:3+nfsiod00:15:051
3930194270,5sleep03930202-21ssh00:13:200
3898887270,3sleep03898926-21apt-get23:55:120
3857327270,5sleep23857335-21ssh23:28:012
3841922270,4sleep03841880-21apt-get23:20:020
3827362271,3sleep23828803-21grep23:10:182
3794212271,4sleep03794709-21sed22:50:160
3785325271,3sleep03785332-21sh22:44:350
3771178270,5sleep23772261-21kthreadcore22:35:192
3768836270,5sleep03768844-21ssh22:33:410
3768473270,1sleep10-21swapper/122:32:461
3737528271,3sleep03737567-21apt-get22:15:140
3737528271,3sleep03737567-21apt-get22:15:130
3734438271,3sleep03734505-21ntp_states22:10:200
3734438271,3sleep03734505-21ntp_states22:10:200
3712518270,4sleep23712544-21apt-get22:00:012
3689776271,3sleep13690907-21kthreadcore21:45:171
3662852270,4sleep13662856-21ssh21:26:491
3621994270,4sleep03624066-21grep21:00:190
3613493270,3sleep13613526-21apt-get20:55:111
3600958270,1sleep10-21swapper/120:45:061
3485352270,1sleep00-21swapper/019:12:030
3478693270,1sleep10-21swapper/119:06:391
14759870,4rtkit-daemon720-21snmpd22:46:212
14759870,4rtkit-daemon515-21gmain23:51:012
14759870,4rtkit-daemon515-21gmain23:35:530
14759870,4rtkit-daemon515-21gmain21:10:052
14759870,4rtkit-daemon515-21gmain20:45:172
14759870,3rtkit-daemon730-21ntpd20:06:162
14759870,3rtkit-daemon730-21ntpd20:06:162
14759870,3rtkit-daemon730-21ntpd19:37:252
14759870,3rtkit-daemon3929944-21ssh00:12:472
14759870,3rtkit-daemon3922274-21ssh00:08:431
14759870,3rtkit-daemon3917877-21cut00:05:192
14759870,3rtkit-daemon3841506-21ssh23:19:171
14759870,3rtkit-daemon3763291-21cut22:30:172
14759870,3rtkit-daemon3591431-21cat20:35:192
14759870,3rtkit-daemon3485788-21munin-node20:11:112
14759870,3rtkit-daemon3485788-21munin-node19:50:072
14759870,3rtkit-daemon3485788-21munin-node19:30:392
14759870,3rtkit-daemon22110-21packagekitd22:16:331
14759870,3rtkit-daemon22110-21packagekitd22:16:331
14759870,3rtkit-daemon22110-21packagekitd20:40:132
14759870,3rtkit-daemon214-21plymouthd21:56:031
14759870,3rtkit-daemon214-21plymouthd19:23:142
14759870,3rtkit-daemon1-21systemd23:55:172
14759870,3rtkit-daemon1-21systemd20:16:312
14759870,2rtkit-daemon214-21plymouthd23:26:140
14759870,2rtkit-daemon214-21plymouthd20:01:072
3968734260,1sleep20-21swapper/200:35:232
3947647260,1sleep20-21swapper/200:25:162
3945851260,1sleep10-21swapper/100:22:101
3897392260,4sleep10-21swapper/123:52:221
3888606260,1sleep00-21swapper/023:45:300
3872902260,1sleep10-21swapper/123:36:341
3850118260,3sleep23850126-21ssh23:25:012
3816122261,3sleep23816129-21sh23:01:362
3807051260,1sleep10-21swapper/122:55:221
3799774260,1sleep10-21swapper/122:50:571
3783629260,1sleep20-21swapper/222:40:402
3775710260,1sleep00-21swapper/022:35:570
3761371260,3sleep03761396-21munin-run22:30:000
3680706261,3sleep03680858-21df21:40:150
3670376260,1sleep10-21swapper/121:30:341
3631793260,1sleep10-21swapper/121:07:021
3606717260,1sleep00-21swapper/020:46:450
3594736260,3sleep13594882-21df20:40:141
3594098260,1sleep00-21swapper/020:35:510
3587907260,1sleep10-21swapper/120:31:311
3581871260,1sleep00-21swapper/020:29:100
3575919260,3sleep13575428-21apt-get20:25:021
3568777260,1sleep10-21swapper/120:15:321
3550655260,3sleep13550811-21diskstats20:05:141
3550655260,3sleep13550811-21diskstats20:05:141
3550345260,1sleep10-21swapper/120:04:501
3544724260,4sleep03544852-21irqcore20:00:160
3544098260,3sleep03544164-21munin-run20:00:000
3531280260,1sleep00-21swapper/019:45:580
3518819260,1sleep10-21swapper/119:37:411
3506437260,1sleep10-21swapper/119:29:201
3499981260,1sleep00-21swapper/019:21:330
3499105261,2sleep10-21swapper/119:20:221
3484934260,3sleep13485184-21unixbench_singl19:10:241
14759860,3rtkit-daemon214-21plymouthd00:18:190
3947404250,3sleep10-21swapper/100:25:121
3944694250,3sleep23944809-21ssh00:20:232
3922580250,3sleep00-21swapper/000:09:230
3907191251,2sleep13907253-21fschecks_count00:00:141
3898931250,3sleep13899006-21cpuspeed_turbos23:55:131
3858212251,2sleep13479172-21cyclictest23:30:001
3808389250,3sleep03808386-21sh22:57:220
3751649250,3sleep00-21swapper/022:21:070
3664585250,2sleep00-21swapper/021:30:130
3656677250,3sleep03656883-21hddtemp_smartct21:25:170
3646188253,1sleep10-21swapper/121:15:351
3620006250,3sleep13620196-21cat21:00:161
3594423250,2sleep10-21swapper/120:40:011
3550644250,2sleep03550652-21apt-get20:05:130
3550644250,2sleep03550652-21apt-get20:05:130
3538094250,2sleep13538127-21apt-get19:55:121
3531271250,1sleep10-21swapper/119:45:511
3514776250,2sleep00-21swapper/019:35:200
3507145250,3sleep13507240-21ps19:30:161
3487924250,3sleep00-21swapper/019:15:040
3485633250,2sleep10-21swapper/119:15:011
3704737240,1sleep20-21swapper/221:55:122
3678554240,1sleep00-21swapper/021:35:580
3646181240,2sleep0214-21plymouthd21:15:340
3575387240,2sleep00-21swapper/020:24:410
3512003240,1sleep00-21swapper/019:30:230
3500547240,2sleep0214-21plymouthd19:25:140
3472989240,1sleep00-21swapper/019:05:140
3785722230,1sleep00-21swapper/022:45:030
3531844230,1sleep10-21swapper/119:50:081
3519000230,1sleep00-21swapper/019:40:020
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional