You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-22 - 20:02
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8.osadl.org (updated Sat Nov 22, 2025 12:43:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3722155992521,1cyclictest0-21swapper/312:00:013
41266252240,3sleep2431ktimers/211:45:012
38515262240,1sleep20-21swapper/208:50:162
372215599237,5cyclictest3780911-21taskset07:54:543
3722155992217,3cyclictest3988845-21sleep10:20:003
3722155992118,1cyclictest0-21swapper/309:25:013
372215599208,7cyclictest39400692sleep309:49:493
3722155992017,1cyclictest0-21swapper/312:00:183
372215599201,15cyclictest3884462-21taskset09:15:173
372215599199,7cyclictest40127972sleep310:34:383
3722155991916,1cyclictest0-21swapper/309:30:233
372215599191,14cyclictest4083797-21chrt11:15:243
3722155991816,1cyclictest0-21swapper/311:10:013
3722155991815,1cyclictest0-21swapper/312:10:173
3722155991815,1cyclictest0-21swapper/311:40:003
3722155991815,1cyclictest0-21swapper/311:00:173
3722155991815,1cyclictest0-21swapper/310:25:203
3722155991815,1cyclictest0-21swapper/308:04:593
372215599181,13cyclictest4119663-21chrt11:40:173
372215599181,13cyclictest4021075-21turbostat10:40:003
372215599181,13cyclictest3844387-21turbostat08:45:003
372215599181,13cyclictest3844387-21turbostat08:44:593
372215599181,13cyclictest3825601-21taskset08:30:143
372215599181,13cyclictest3736735-21turbostat07:20:013
372215599180,13cyclictest3916177-21taskset09:35:023
372215599180,13cyclictest3812276-21taskset08:19:563
372215599180,13cyclictest3793736-21taskset08:05:013
372215599177,7cyclictest40699672sleep311:09:523
3722155991714,1cyclictest0-21swapper/311:50:003
3722155991714,1cyclictest0-21swapper/311:20:193
3722155991714,1cyclictest0-21swapper/310:55:143
3722155991714,1cyclictest0-21swapper/310:00:183
3722155991714,1cyclictest0-21swapper/307:40:203
372215599171,13cyclictest4036872-21taskset10:49:153
372215599171,13cyclictest3878957-21taskset09:10:173
372215599171,13cyclictest3805792-21chrt08:12:303
372215599171,12cyclictest4141234-21chrt11:51:033
372215599171,12cyclictest4094382-21sleep11:29:553
372215599171,12cyclictest3992850-21taskset10:20:183
372215599171,12cyclictest3768472-21sleep07:49:553
372215599170,13cyclictest3972491-21taskset10:10:003
372215599170,13cyclictest17029-21chrt12:35:193
372215599167,6cyclictest3743066-21taskset07:22:373
3722155991613,1cyclictest0-21swapper/310:52:233
3722155991613,1cyclictest0-21swapper/310:52:223
3722155991613,1cyclictest0-21swapper/309:40:173
372215599161,12cyclictest7206-21taskset12:30:173
372215599161,12cyclictest4102665-21taskset11:30:073
372215599161,12cyclictest4027823-21chrt10:41:543
372215599161,12cyclictest3947949-21taskset09:54:173
372215599161,12cyclictest3905158-21taskset09:25:193
372215599161,12cyclictest3856765-21taskset08:53:383
372215599161,12cyclictest3850606-21chrt08:49:573
372215599161,12cyclictest3787083-21taskset07:58:443
372215599161,12cyclictest3762160-21turbostat07:40:003
372215599161,12cyclictest3755625-21chrt07:32:593
372215599161,12cyclictest3728114-21taskset07:11:513
372215599161,11cyclictest4191810-21taskset12:25:013
372215599161,11cyclictest3948491-21taskset09:55:053
372215599160,12cyclictest3972967-21taskset10:10:033
37684412151,10sleep13768642-21cut07:45:001
3722155991512,1cyclictest0-21swapper/312:20:133
3722155991512,1cyclictest0-21swapper/308:35:153
372215599151,11cyclictest4176120-21chrt12:15:153
372215599151,11cyclictest4159597-21taskset12:05:063
372215599151,11cyclictest3869693-21taskset09:05:123
372215599151,11cyclictest3857119-21taskset08:55:023
372215599151,11cyclictest3825018-21taskset08:26:173
372215599151,11cyclictest3818460-21taskset08:20:363
372215599151,11cyclictest3749328-21taskset07:27:343
372215599150,12cyclictest3865053-21taskset09:00:193
147598150,8rtkit-daemon3891450-21ssh09:19:181
40961142140,3sleep24097348-21kthreadcore11:25:182
38253072140,10sleep13825441-21ls08:30:001
147598130,10rtkit-daemon729-21lldpd07:59:151
39522932121,8sleep23953600-21ssh09:55:212
38831902121,8sleep13883197-21sh09:13:491
37815732121,9sleep00-21swapper/007:55:170
37411232120,9sleep03742225-21/usr/sbin/munin07:20:220
147598120,8rtkit-daemon3994925-21ssh10:20:300
147598120,8rtkit-daemon3914751-21ssh09:32:172
41082252110,4sleep04108475-21users11:30:250
40779202110,1sleep20-21swapper/211:14:322
40696932110,9sleep04069695-21ssh11:09:160
40606782110,8sleep04060686-21ssh11:02:440
38850292111,7sleep03886047-21cat09:15:200
38406662110,8sleep23842744-21cut08:40:192
38406662110,8sleep23842744-21cut08:40:192
38126452110,3sleep13812313-21apt-get08:20:071
218842110,8sleep221946-21idleruntime-cro12:40:002
147598110,7rtkit-daemon4101768-21ssh11:28:360
147598110,7rtkit-daemon4093982-21sh11:24:072
147598110,7rtkit-daemon3949244-21cut09:55:181
147598110,6rtkit-daemon331ktimers/112:05:191
147598110,4rtkit-daemon4117455-21ssh11:37:340
41651332100,7sleep24165392-21sed12:05:262
40316062100,7sleep04033601-21tr10:45:210
39812792100,7sleep23981487-21sort10:15:172
39612107,1sleep03988290-21kworker/0:0+kacpid12:25:430
39143022100,1sleep10-21swapper/109:31:121
38571312101,5sleep03857164-21apt-get08:55:110
37162792100,7sleep03716346-21fschecks_count07:05:160
147598100,6rtkit-daemon1540-21sendmail-mta10:05:571
147598100,5rtkit-daemon3825933-21grep08:30:161
147598100,4rtkit-daemon214-21plymouthd09:22:581
147598100,2rtkit-daemon214-21plymouthd10:52:540
147598100,2rtkit-daemon214-21plymouthd10:52:540
147598100,1rtkit-daemon0-21swapper/110:10:221
147598100,1rtkit-daemon0-21swapper/107:05:521
8364290,6sleep010355-21cut12:30:200
4175999291,2sleep20-21swapper/212:15:152
4149571290,3sleep1214-21plymouthd11:56:031
4110252290,1sleep20-21swapper/211:34:362
4104170290,6sleep14105874-21kthreadcore11:30:181
4078466291,4sleep14078469-21apt-get11:15:141
4036640290,1sleep10-21swapper/110:48:421
4029890290,6sleep24030482-21irqrtprio10:45:182
3962030290,7sleep03962197-21cat10:00:240
3931616290,1sleep00-21swapper/009:43:560
3831830291,5sleep23831863-21apt-get08:35:152
3815487290,6sleep23817599-21kthreadcore08:20:202
3807212290,6sleep13808320-21kthreadcore08:15:171
3743718290,6sleep03743918-21hddtemp_smartct07:25:160
3743549294,2sleep23743662-21cut07:25:142
3729320290,1sleep10-21swapper/107:15:031
3722327291,4sleep13722360-21apt-get07:10:141
37221559997,1cyclictest0-21swapper/307:10:003
3716096291,3sleep23716129-21apt-get07:05:142
21035290,1sleep10-21swapper/112:38:071
14759890,6rtkit-daemon720-21snmpd10:22:532
14759890,6rtkit-daemon515-21gmain12:27:201
14759890,6rtkit-daemon1540-21sendmail-mta09:09:361
14759890,5rtkit-daemon3922023-21awk09:35:282
14759890,5rtkit-daemon3728519-21munin-node12:23:231
14759890,5rtkit-daemon22110-21packagekitd12:13:311
14759890,4rtkit-daemon3945606-21memory09:50:211
14759890,4rtkit-daemon3904514-21kthreadcore09:25:192
14759890,4rtkit-daemon214-21plymouthd11:49:060
14759890,4rtkit-daemon14362-21diskstats12:35:150
14759890,3rtkit-daemon1-21systemd11:59:320
14759890,2rtkit-daemon214-21plymouthd11:41:500
14759890,2rtkit-daemon214-21plymouthd07:33:281
4190099280,6sleep24190107-21ssh12:21:322
4177231280,5sleep14178538-21kthreadcore12:15:181
4084372280,1sleep00-21swapper/011:15:450
4019435280,1sleep10-21swapper/110:36:191
3980591280,1sleep00-21swapper/010:14:470
3962375281,4sleep23962386-21ssh10:00:252
3940938280,5sleep03941416-21irqcore09:50:180
3930729280,5sleep23930737-21ssh09:41:552
3924339281,3sleep13924372-21apt-get09:40:141
3825570281,4sleep23825598-21apt-get08:30:142
3795817280,5sleep13797835-21kthreadcore08:05:201
3775614280,5sleep13776396-21kthreadcore07:50:211
3756045281,3sleep03756076-21apt-get07:35:140
14759880,5rtkit-daemon214-21plymouthd11:03:182
14759880,4rtkit-daemon515-21gmain08:35:291
14759880,4rtkit-daemon4052337-21ssh10:57:062
14759880,4rtkit-daemon3981479-21hddtemp_smartct10:15:170
14759880,4rtkit-daemon3728519-21munin-node08:51:441
14759880,4rtkit-daemon214-21plymouthd10:36:320
14759880,4rtkit-daemon214-21plymouthd07:38:131
14759880,4rtkit-daemon1-21systemd10:44:280
14759880,4rtkit-daemon1-21systemd10:26:282
14759880,4rtkit-daemon1-21systemd08:44:451
14759880,4rtkit-daemon1-21systemd08:44:451
14759880,4rtkit-daemon1-21systemd08:12:491
14759880,1rtkit-daemon0-21swapper/109:48:381
13171280,5sleep113179-21ssh12:33:341
4191896271,3sleep24191931-21apt-get12:25:132
4186233270,4sleep00-21swapper/012:20:180
4176289271,3sleep04177230-21irqstats12:15:170
4171026270,5sleep04172795-21latency12:10:200
4157097271,3sleep14157352-21/usr/sbin/munin12:00:241
4141621270,5sleep14141627-21ssh11:51:541
4076300270,1sleep10-21swapper/111:10:501
4051925270,5sleep10-21swapper/110:56:081
4004628271,4sleep14004636-21ssh10:29:231
3949525270,5sleep03950027-21kthreadcore09:55:190
3908414270,4sleep03908538-21perl09:30:150
3907839271,3sleep13907844-21turbostat.cron09:29:561
3883101270,5sleep23883110-21ssh09:13:382
3868814270,4sleep13869031-21users09:00:261
3846662271,3sleep03848703-21cut08:45:170
3817881270,1sleep00-21swapper/008:20:220
3806250271,3sleep03806283-21apt-get08:15:130
3805895270,1sleep00-21swapper/008:13:490
3799762270,5sleep20-21swapper/208:09:502
3788859272,2sleep00-21swapper/008:00:180
3768437271,4sleep2720-21snmpd07:44:562
14759870,4rtkit-daemon730-21ntpd10:55:450
14759870,4rtkit-daemon720-21snmpd11:06:552
14759870,4rtkit-daemon720-21snmpd07:24:031
14759870,3rtkit-daemon729-21lldpd09:24:472
14759870,3rtkit-daemon720-21snmpd10:01:351
14759870,3rtkit-daemon4135282-21apt-get11:50:140
14759870,3rtkit-daemon4012370-21ssh10:33:391
14759870,3rtkit-daemon214-21plymouthd08:02:521
14759870,3rtkit-daemon1-21systemd12:00:040
14759870,3rtkit-daemon1-21systemd11:15:072
14759870,3rtkit-daemon1-21systemd10:30:132
14759870,3rtkit-daemon1-21systemd09:46:322
14759870,3rtkit-daemon1-21systemd08:45:371
14759870,3rtkit-daemon1-21systemd07:45:221
14759870,3rtkit-daemon1-21systemd07:25:071
13370270,4sleep213374-21ssh12:33:582
4149580260,3sleep24149587-21sh11:56:042
4142429260,1sleep20-21swapper/211:53:512
4134058261,3sleep24134066-21ssh11:47:582
4133119260,1sleep10-21swapper/111:45:491
4124636260,1sleep10-21swapper/111:40:321
4117483262,3sleep1331ktimers/111:37:391
4101699260,4sleep14101704-21sh11:28:211
4094113260,1sleep00-21swapper/011:24:280
4093419260,1sleep10-21swapper/111:22:491
4061972260,2sleep10-21swapper/111:05:131
4045354260,1sleep20-21swapper/210:54:362
4045354260,1sleep20-21swapper/210:54:362
4028703260,1sleep20-21swapper/210:44:022
4028537260,3sleep14028545-21ssh10:43:411
4019465263,1sleep20-21swapper/210:36:252
3976075262,1sleep20-21swapper/210:10:202
3972282261,3sleep03972290-21ssh10:09:420
3971673260,1sleep20-21swapper/210:08:162
3923523260,1sleep00-21swapper/009:39:000
3907498260,1sleep00-21swapper/009:29:060
3890609260,1sleep20-21swapper/209:17:172
3870111260,4sleep23870926-21cut09:05:152
3869307260,1sleep00-21swapper/009:03:500
3856627260,1sleep00-21swapper/008:51:520
3844068260,1sleep00-21swapper/008:41:100
3844068260,1sleep00-21swapper/008:41:100
3806237260,1sleep20-21swapper/208:15:032
3793788260,3sleep03793890-21grep08:05:140
3793391260,1sleep20-21swapper/208:03:452
3774998260,3sleep23775154-21diskstats07:50:182
3772366261,3sleep03773669-21memory07:45:230
3769386260,3sleep23770353-21tr07:45:212
3749776261,2sleep00-21swapper/007:30:130
3738206261,2sleep20-21swapper/207:20:212
3736707260,3sleep23736736-21munin-run07:20:012
3735832260,1sleep00-21swapper/007:15:220
14759860,3rtkit-daemon720-21snmpd08:55:041
4167760250,2sleep20-21swapper/212:10:142
4162510250,2sleep04164621-21kthreadcore12:05:200
4157631250,3sleep20-21swapper/212:01:052
4117459250,3sleep24117465-21ssh11:37:352
4076182250,4sleep00-21swapper/011:10:290
4060817250,3sleep134-21ksoftirqd/111:03:011
4043067250,3sleep10-21swapper/110:50:231
4043067250,3sleep10-21swapper/110:50:231
3945815250,2sleep2421rcuc/209:50:242
3933251250,3sleep03934162-21cut09:45:210
3923379250,3sleep10-21swapper/109:38:331
3881018250,3sleep03881202-21ssh09:10:190
3869843250,3sleep03869911-21grep09:05:140
3864247251,1sleep20-21swapper/209:00:192
3862999250,1sleep20-21swapper/208:58:512
3844627250,3sleep23844660-21apt-get08:45:122
3832010250,3sleep03832035-21/usr/sbin/munin08:35:170
3825758250,3sleep03825912-21gltestperf08:30:160
3819325250,3sleep20-21swapper/208:25:122
3774961250,3sleep03774981-21awk07:50:160
3755624250,1sleep20-21swapper/207:32:592
3722363251,2sleep20-21swapper/207:10:152
4011181241,1sleep00-21swapper/010:30:540
3997354241,2sleep03875695-21diskmemload10:25:120
3989150240,2sleep10-21swapper/110:20:131
3983242240,2sleep10-21swapper/110:15:201
3898889240,2sleep0214-21plymouthd09:22:490
3820727240,2sleep03822216-21kthreadcore08:25:190
3782698240,2sleep20-21swapper/207:55:192
3762406240,3sleep00-21swapper/007:40:030
3761977240,3sleep20-21swapper/207:37:562
3728324240,3sleep00-21swapper/007:14:330
3800028230,1sleep20-21swapper/208:10:102
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional