You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-16 - 13:19
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot8.osadl.org (updated Sun Nov 16, 2025 00:43:56)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
56740021010,2sleep0567403-21unixbench_multi19:55:260
7534142330,1sleep20-21swapper/222:10:132
502804993329,1cyclictest0-21swapper/321:25:013
502804992521,1cyclictest0-21swapper/320:00:013
502804992421,1cyclictest0-21swapper/323:50:013
502804992219,1cyclictest0-21swapper/323:25:013
502804992118,1cyclictest0-21swapper/320:10:193
502804992117,2cyclictest987065-21turbostat00:35:003
502804992111,7cyclictest8858802sleep323:30:193
502804991916,1cyclictest0-21swapper/319:15:013
50280499187,8cyclictest8924272sleep323:35:203
502804991815,1cyclictest0-21swapper/323:25:203
502804991815,1cyclictest0-21swapper/322:40:183
502804991815,1cyclictest0-21swapper/322:10:143
502804991815,1cyclictest0-21swapper/321:00:013
502804991815,1cyclictest0-21swapper/300:05:183
50280499181,13cyclictest914830-21taskset23:50:133
50280499181,13cyclictest839116-21taskset23:00:203
50280499181,13cyclictest798838-21taskset22:35:243
50280499181,13cyclictest748496-21taskset22:05:183
50280499181,13cyclictest712916-21taskset21:45:143
50280499181,13cyclictest704543-21sleep21:40:003
50280499181,13cyclictest580374-21turbostat20:10:003
9366552170,6sleep0151ktimers/000:00:240
50280499177,7cyclictest7440712sleep322:03:103
502804991715,1cyclictest0-21swapper/321:15:023
502804991714,1cyclictest0-21swapper/323:40:183
502804991714,1cyclictest0-21swapper/321:55:243
502804991714,1cyclictest0-21swapper/319:30:183
502804991714,1cyclictest0-21swapper/300:25:143
50280499171,13cyclictest987432-21chrt00:35:133
50280499171,13cyclictest767172-21chrt22:15:523
50280499171,13cyclictest529757-21chrt19:26:533
50280499171,12cyclictest856518-21chrt23:11:423
50280499171,12cyclictest817694-21taskset22:50:143
50280499171,12cyclictest809649-21taskset22:45:143
50280499171,12cyclictest775171-21taskset22:20:403
50280499171,12cyclictest661942-21taskset21:10:323
50280499171,12cyclictest536803-21taskset19:35:153
50280499170,13cyclictest555485-21chrt19:50:013
50280499170,12cyclictest704775-21taskset21:40:013
5258552160,8sleep0527856-21kthreadcore19:25:230
502804991613,1cyclictest0-21swapper/322:35:003
502804991613,1cyclictest0-21swapper/321:30:223
502804991613,1cyclictest0-21swapper/320:32:543
502804991613,1cyclictest0-21swapper/319:20:253
50280499161,12cyclictest961531-21taskset00:16:503
50280499161,12cyclictest777358-21chrt22:25:143
50280499161,12cyclictest726830-21taskset21:50:473
50280499161,12cyclictest681023-21chrt21:25:143
50280499161,12cyclictest630365-21chrt20:45:343
50280499161,12cyclictest593028-21taskset20:18:473
50280499161,12cyclictest549057-21turbostat19:45:003
50280499161,12cyclictest517098-21chrt19:15:473
50280499161,11cyclictest619569-21taskset20:40:183
50280499161,11cyclictest612221-21taskset20:35:093
50280499160,13cyclictest952953-21chrt00:10:413
50280499160,13cyclictest865257-21chrt23:18:163
50280499160,13cyclictest568967-21taskset20:00:153
50280499160,12cyclictest847931-21chrt23:05:323
50280499160,12cyclictest605371-21chrt20:25:473
147598160,2rtkit-daemon0-21swapper/023:01:170
502804991512,1cyclictest0-21swapper/321:05:203
502804991512,1cyclictest0-21swapper/321:05:203
502804991512,1cyclictest0-21swapper/300:00:173
50280499151,12cyclictest561445-21taskset19:52:533
50280499151,11cyclictest969461-21taskset00:21:273
50280499151,11cyclictest929502-21chrt23:57:273
50280499151,11cyclictest643563-21taskset21:00:103
50280499151,11cyclictest630956-21taskset20:50:043
50280499151,11cyclictest593403-21taskset20:20:113
50280499150,12cyclictest825935-21chrt22:55:063
147598140,10rtkit-daemon857345-21ssh23:13:390
8749122131,9sleep1875234-21cut23:25:201
8514252130,6sleep2852556-21grep23:10:182
147598130,9rtkit-daemon720-21snmpd00:11:161
147598130,9rtkit-daemon562588-21sed19:55:192
147598130,3rtkit-daemon214-21plymouthd23:40:212
9938522120,9sleep1993860-21ssh00:37:011
7632572120,8sleep0765219-21cut22:15:170
6070742121,8sleep0608076-21kthreadcore20:30:230
5681312120,8sleep2568132-21/usr/sbin/munin20:00:112
5091352120,9sleep1509834-21tr19:15:021
147598120,8rtkit-daemon800709-21ssh22:38:542
147598120,7rtkit-daemon1540-21sendmail-mta20:19:162
9765672110,8sleep2976612-21grep00:25:232
9699342110,8sleep0969940-21ssh00:22:380
9642462111,7sleep1965201-21cat00:20:181
9555692111,7sleep2955769-21cut00:15:172
9464522114,5sleep0946459-21diskmemload00:09:180
9134192110,8sleep0913427-21ssh23:47:350
8987022110,8sleep0898851-21df23:40:140
6394652110,8sleep0641498-21tr20:55:230
5825212110,8sleep2584495-21grep20:10:212
147598110,7rtkit-daemon995063-21ssh00:39:462
147598110,7rtkit-daemon873848-21ssh23:24:190
147598110,7rtkit-daemon832636-21ssh22:57:350
147598110,7rtkit-daemon718926-21ssh21:46:021
147598110,7rtkit-daemon607582-21cut20:30:222
147598110,6rtkit-daemon476-21wpa_supplicant00:21:502
147598110,5rtkit-daemon521668-21cut19:20:182
147598110,3rtkit-daemon1540-21sendmail-mta23:15:420
8158552100,7sleep2815863-21ssh22:46:412
7504192100,7sleep2750488-21processes22:05:222
6270782100,7sleep0627756-21kthreadcore20:45:210
6144492100,6sleep2616485-21kthreadcore20:35:212
5026172100,1sleep30-21swapper/319:09:273
147598100,6rtkit-daemon515-21gmain23:25:500
147598100,6rtkit-daemon1540-21sendmail-mta23:33:302
147598100,6rtkit-daemon1540-21sendmail-mta22:49:220
147598100,4rtkit-daemon729-21lldpd21:22:331
882857290,6sleep0883120-21cut23:30:150
848623290,1sleep00-21swapper/023:07:120
793894291,5sleep0794831-21irqstats22:35:170
738877290,1sleep2740868-21kthreadcore22:00:202
735548290,6sleep0735556-21ssh21:57:110
648577291,5sleep1648679-21/usr/sbin/munin21:00:201
611965290,6sleep1611977-21latency_hist20:35:001
555581291,5sleep20-21swapper/219:50:132
503564290,6sleep0504471-21kthreadcore19:10:190
14759890,6rtkit-daemon1540-21sendmail-mta21:36:121
14759890,6rtkit-daemon1540-21sendmail-mta20:47:272
14759890,5rtkit-daemon655831-21diskmemload23:55:202
14759890,5rtkit-daemon214-21plymouthd21:44:561
14759890,5rtkit-daemon1540-21sendmail-mta20:09:272
14759890,5rtkit-daemon1-21systemd21:02:282
14759890,4rtkit-daemon642605-21python320:55:282
14759890,4rtkit-daemon530291-21apt-get19:30:122
14759890,1rtkit-daemon0-21swapper/223:45:202
14759890,1rtkit-daemon0-21swapper/022:32:390
945594281,4sleep2945601-21sh00:07:172
914444281,4sleep1914455-21cron23:50:011
889658280,6sleep10-21swapper/123:33:411
873336280,1sleep10-21swapper/123:23:151
864555280,1sleep20-21swapper/223:16:392
832924284,2sleep244-21ksoftirqd/222:58:112
753263280,6sleep1753413-21sh22:10:141
731671281,4sleep2733697-21grep21:55:202
710026280,5sleep0710094-21ntpq21:40:230
704294280,1sleep00-21swapper/021:39:350
648858280,5sleep0649028-21timerwakeupswit21:00:230
567845280,1sleep10-21swapper/119:59:531
549895283,2sleep10-21swapper/119:45:191
502432280,1sleep00-21swapper/019:07:040
14759880,4rtkit-daemon896401-21ssh23:35:322
14759880,4rtkit-daemon729-21lldpd19:45:442
14759880,4rtkit-daemon623627-21ntpq20:40:232
14759880,4rtkit-daemon509182-21munin-node22:33:511
14759880,4rtkit-daemon509182-21munin-node22:13:060
14759880,4rtkit-daemon509182-21munin-node21:32:551
14759880,4rtkit-daemon509182-21munin-node20:20:072
14759880,4rtkit-daemon503153-21cut19:10:152
14759880,4rtkit-daemon313-21systemd-udevd19:39:432
14759880,4rtkit-daemon214-21plymouthd22:50:240
14759880,4rtkit-daemon214-21plymouthd21:12:552
14759880,3rtkit-daemon779413-21kthreadcore22:25:191
14759880,3rtkit-daemon214-21plymouthd22:40:132
14759880,3rtkit-daemon214-21plymouthd22:20:380
14759880,2rtkit-daemon0-21swapper/221:18:462
14759880,2rtkit-daemon0-21swapper/220:52:272
14759880,1rtkit-daemon0-21swapper/220:25:442
14759880,1rtkit-daemon0-21swapper/219:18:222
987587270,4sleep0987691-21fschecks_time00:35:160
979549270,1sleep20-21swapper/200:30:172
875235271,4sleep2876096-21cat23:25:212
850178271,3sleep1850217-21apt-get23:10:131
825037271,4sleep2825045-21ssh22:54:112
809261271,3sleep10-21swapper/122:45:001
784949270,1sleep20-21swapper/222:29:552
783147270,1sleep00-21swapper/022:25:390
776471270,1sleep20-21swapper/222:23:462
761199271,3sleep2761238-21apt-get22:15:122
717938271,4sleep2712875-21/usr/sbin/munin21:45:222
702554271,4sleep2670744-21kworker/u16:2+xprtiod21:35:332
669493270,4sleep1669623-21sensors_temp21:15:241
593802270,5sleep1594176-21sed20:20:181
524001271,3sleep2524034-21apt-get19:25:172
512777270,4sleep0514010-21cut19:15:210
14759870,3rtkit-daemon730-21ntpd19:05:562
14759870,3rtkit-daemon509182-21munin-node23:50:562
14759870,3rtkit-daemon509182-21munin-node19:41:302
14759870,3rtkit-daemon295-21systemd-journal21:05:472
14759870,3rtkit-daemon295-21systemd-journal21:05:462
14759870,3rtkit-daemon1540-21sendmail-mta21:50:161
14759870,3rtkit-daemon1-21systemd23:59:310
14759870,3rtkit-daemon1-21systemd22:35:561
14759870,3rtkit-daemon1-21systemd21:20:322
14759870,2rtkit-daemon214-21plymouthd21:25:061
987037260,3sleep0987050-21cron00:35:000
986293260,4sleep10-21swapper/100:33:171
977874260,1sleep10-21swapper/100:27:181
946257260,4sleep10-21swapper/100:08:471
915155260,4sleep1915296-21irqcore23:50:171
897197260,4sleep10-21swapper/123:37:261
849095260,1sleep20-21swapper/223:08:182
842114260,4sleep1842274-21df_inode23:05:121
841738260,1sleep10-21swapper/123:05:001
840290260,1sleep20-21swapper/223:01:332
824190260,1sleep10-21swapper/122:52:181
816229260,3sleep1816237-21ssh22:47:281
806803261,2sleep00-21swapper/022:40:230
744378260,1sleep10-21swapper/122:03:561
742173261,2sleep0221rcuc/022:00:230
734893260,1sleep10-21swapper/121:55:391
726735262,2sleep0655831-21diskmemload21:50:280
715044261,2sleep00-21swapper/021:45:200
696338260,1sleep20-21swapper/221:34:522
688200260,1sleep0214-21plymouthd21:29:460
678005261,2sleep00-21swapper/021:20:240
659843260,3sleep0661155-21memory21:10:180
655503260,1sleep10-21swapper/121:06:021
655503260,1sleep10-21swapper/121:06:011
650205261,2sleep0650551-21sed21:05:170
650205261,2sleep0650551-21sed21:05:170
633317260,3sleep1214-21plymouthd20:50:181
631003260,3sleep0631146-21df20:50:130
623669261,2sleep00-21swapper/020:40:230
586597260,3sleep1586619-21apt-get20:15:001
586386260,1sleep10-21swapper/120:12:201
580209260,1sleep00-21swapper/020:08:060
573965260,1sleep00-21swapper/020:03:060
561521260,1sleep00-21swapper/019:53:520
554988260,1sleep00-21swapper/019:45:420
548956260,1sleep10-21swapper/119:43:591
542759260,1sleep00-21swapper/019:39:540
536204260,1sleep00-21swapper/019:34:330
529874260,1sleep10-21swapper/119:28:241
523528260,1sleep10-21swapper/119:22:221
523522260,1sleep00-21swapper/019:22:180
14759860,3rtkit-daemon515-21gmain00:10:100
971727251,2sleep00-21swapper/000:25:180
962136250,2sleep00-21swapper/000:18:160
953134251,2sleep2952125-21kworker/u16:3+rpciod00:11:052
938262250,2sleep1800483-21kworker/u16:4+xprtiod00:04:031
923345250,2sleep10-21swapper/123:55:181
872697252,1sleep20-21swapper/223:21:402
859123251,2sleep10-21swapper/123:15:181
832816250,3sleep1214-21plymouthd22:57:591
775527251,2sleep1502798-21cyclictest22:21:361
745589250,2sleep00-21swapper/022:05:160
723144250,3sleep2725121-21cut21:50:182
711002250,3sleep20-21swapper/221:41:262
688246250,2sleep20-21swapper/221:29:562
671289250,3sleep00-21swapper/021:18:390
656564250,3sleep1657016-21cut21:10:151
643230252,2sleep1331ktimers/120:59:171
624981250,2sleep10-21swapper/120:45:181
612213250,3sleep00-21swapper/020:35:040
605049250,2sleep00-21swapper/020:25:260
599245250,3sleep00-21swapper/020:22:370
593098250,1sleep00-21swapper/020:19:410
530258250,2sleep1214-21plymouthd19:30:131
498088250,2sleep10-21swapper/119:05:201
14759850,1rtkit-daemon0-21swapper/100:15:091
930947240,2sleep2930955-21ssh00:00:112
920743241,1sleep00-21swapper/023:50:480
900780240,2sleep10-21swapper/123:40:181
896708240,2sleep0655831-21diskmemload23:36:170
785324240,2sleep20-21swapper/222:30:112
767346240,2sleep1767354-21ssh22:16:151
752575240,2sleep10-21swapper/122:09:221
695072240,3sleep00-21swapper/021:31:570
624335240,2sleep1214-21plymouthd20:43:021
599696240,1sleep10-21swapper/120:25:141
580616240,2sleep00-21swapper/020:10:150
576361240,2sleep1578369-21kthreadcore20:05:181
548881240,2sleep01474-21rtkit-daemon19:43:020
504473240,1sleep10-21swapper/119:10:201
613297230,1sleep10-21swapper/120:35:211
567920230,1sleep10-21swapper/120:00:021
555570230,1sleep10-21swapper/119:50:041
536245230,1sleep10-21swapper/119:35:021
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional