You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-27 - 04:01
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8.osadl.org (updated Thu Nov 27, 2025 00:43:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
70931993424,7cyclictest199925-21sleep21:00:003
70931992219,1cyclictest0-21swapper/322:25:243
7093199221,17cyclictest512912-21turbostat00:15:003
70931992118,1cyclictest0-21swapper/321:35:003
70931992118,1cyclictest0-21swapper/321:15:223
70931992114,5cyclictest129406-21turbostat19:55:013
29389822117,2sleep20-21swapper/222:00:012
70931992017,1cyclictest0-21swapper/322:55:223
70931992017,1cyclictest0-21swapper/321:04:593
70931991917,1cyclictest0-21swapper/321:25:013
70931991916,1cyclictest0-21swapper/322:15:013
7093199191,14cyclictest187671-21taskset20:50:113
7093199191,13cyclictest367409-21taskset22:45:003
70931991816,1cyclictest0-21swapper/322:00:003
70931991815,1cyclictest0-21swapper/321:25:143
70931991815,1cyclictest0-21swapper/319:55:173
70931991815,1cyclictest0-21swapper/319:45:003
70931991815,1cyclictest0-21swapper/300:20:173
7093199181,13cyclictest77144-21turbostat19:15:003
7093199181,13cyclictest504522-21chrt00:09:163
7093199181,13cyclictest488716-21turbostat00:00:003
7093199181,13cyclictest123123-21turbostat19:50:013
7093199181,13cyclictest123123-21turbostat19:50:003
7093199177,7cyclictest5438272sleep300:32:023
70931991715,1cyclictest0-21swapper/321:50:173
70931991714,1cyclictest0-21swapper/323:35:153
70931991714,1cyclictest0-21swapper/323:10:203
70931991714,1cyclictest0-21swapper/322:20:173
70931991714,1cyclictest0-21swapper/300:35:193
70931991713,1cyclictest0-21swapper/323:00:173
7093199171,12cyclictest496770-21taskset00:04:563
7093199171,12cyclictest496770-21taskset00:04:553
7093199171,12cyclictest305905-21taskset22:05:183
7093199171,12cyclictest173891-21chrt20:31:033
7093199171,12cyclictest166374-21taskset20:20:183
7093199170,12cyclictest148498-21taskset20:09:553
7093199167,7cyclictest3746302sleep322:48:473
7093199167,6cyclictest2687832sleep321:42:553
7093199166,7cyclictest5185102sleep300:15:223
70931991613,1cyclictest0-21swapper/323:40:323
70931991613,1cyclictest0-21swapper/320:20:013
7093199161,12cyclictest91611-21taskset19:22:243
7093199161,12cyclictest85454-21chrt19:19:183
7093199161,12cyclictest446809-21chrt23:31:183
7093199161,12cyclictest432235-21taskset23:25:043
7093199161,12cyclictest431024-21chrt23:23:213
7093199161,12cyclictest382318-21chrt22:52:513
7093199161,12cyclictest167522-21taskset20:25:033
7093199161,12cyclictest110345-21taskset19:36:503
7093199161,11cyclictest141935-21taskset20:00:513
7093199160,12cyclictest470732-21chrt23:45:373
7093199160,12cyclictest212478-21taskset21:09:553
7093199160,12cyclictest180935-21chrt20:42:213
7093199156,6cyclictest2700442sleep321:45:103
70931991512,1cyclictest0-21swapper/323:50:153
70931991512,1cyclictest0-21swapper/320:45:223
7093199151,12cyclictest98303-21taskset19:30:053
7093199151,11cyclictest97783-21taskset19:26:283
7093199151,11cyclictest421747-21taskset23:15:343
7093199151,11cyclictest405747-21taskset23:05:563
7093199151,11cyclictest351276-21chrt22:35:073
7093199151,11cyclictest349897-21taskset22:32:263
7093199151,11cyclictest324955-21taskset22:15:483
7093199151,11cyclictest300300-21taskset22:00:293
7093199151,11cyclictest219319-21chrt21:11:363
7093199151,11cyclictest154528-21taskset20:11:573
7093199150,12cyclictest260696-21chrt21:38:283
7093199150,12cyclictest174484-21chrt20:35:333
70931991411,1cyclictest0-21swapper/300:25:183
2587252140,4sleep1331ktimers/121:35:181
648532131,5sleep164886-21apt-get19:05:121
1864872130,6sleep0186543-21ntp_states20:45:210
147598130,9rtkit-daemon295-21systemd-journal20:39:431
147598130,3rtkit-daemon214-21plymouthd23:18:350
707892120,2sleep30-21swapper/319:09:533
5520662121,8sleep1552072-21ssh00:37:251
5416972120,9sleep0542432-21ssh00:30:180
4637012121,3sleep0212495-21diskmemload23:43:050
3265262120,9sleep1326534-21ssh22:19:281
3259682121,8sleep2325976-21ssh22:18:122
3167492120,8sleep0316757-21ssh22:10:360
3014312120,9sleep2301439-21ssh22:03:092
4555192110,8sleep2455527-21ssh23:37:592
3099872110,8sleep2309993-21ssh22:08:342
2442462111,7sleep2720-21snmpd21:27:462
2291802111,7sleep1229143-21/usr/sbin/munin21:20:121
2272942110,2sleep00-21swapper/021:16:300
147598110,7rtkit-daemon515-21gmain19:25:012
147598110,7rtkit-daemon456-21avahi-daemon00:03:580
147598110,7rtkit-daemon456-21avahi-daemon00:03:580
147598110,6rtkit-daemon341595-21ssh22:26:572
147598110,1rtkit-daemon0-21swapper/122:04:401
5032202100,1sleep00-21swapper/000:06:150
3981272100,7sleep1398134-21sh23:02:001
3603552100,3sleep1361490-21cut22:40:151
3396912100,7sleep0340264-21sort22:25:200
2926552105,2sleep1292663-21ssh21:57:071
2855572100,7sleep2285565-21ssh21:54:282
2782592101,6sleep1278406-21grep21:50:131
2705372101,6sleep0270560-21irqcore21:45:160
1685572100,7sleep1169002-21irqcore20:30:101
147598100,7rtkit-daemon720-21snmpd22:34:050
147598100,6rtkit-daemon1540-21sendmail-mta00:15:020
147598100,6rtkit-daemon122892-21taskset19:47:162
147598100,6rtkit-daemon122892-21taskset19:47:152
147598100,5rtkit-daemon430619-21kworker/u16:3-rpciod00:29:491
147598100,3rtkit-daemon77010-21pool-udisksd19:13:382
528415290,7sleep1528423-21ssh00:23:341
528132290,7sleep2528140-21ssh00:22:522
472322290,3sleep2472324-21ssh23:49:252
402242290,6sleep2404300-21grep23:05:162
309083290,6sleep1309091-21ssh22:06:331
261971291,4sleep1261974-21apt-get21:40:121
14759890,6rtkit-daemon515-21gmain20:10:212
14759890,6rtkit-daemon1540-21sendmail-mta22:44:210
14759890,5rtkit-daemon476-21wpa_supplicant21:29:020
14759890,4rtkit-daemon161297-21apt-get20:20:102
14759890,3rtkit-daemon551470-21ssh00:36:000
14759890,2rtkit-daemon214-21plymouthd20:15:362
14759890,1rtkit-daemon0-21swapper/221:17:002
122338290,6sleep0122455-21wc19:45:220
122338290,6sleep0122455-21wc19:45:220
520766280,2sleep2520774-21ssh00:19:342
512437281,4sleep2512445-21ssh00:13:582
503835280,2sleep2503843-21ssh00:07:402
441134280,5sleep1441790-21irqrtprio23:30:161
434915280,5sleep2436950-21kthreadcore23:25:202
391662280,2sleep20-21swapper/223:00:122
375481281,3sleep1375516-21apt-get22:50:131
313029281,5sleep20-21swapper/222:10:182
292962280,1sleep00-21swapper/021:57:460
285729280,1sleep00-21swapper/021:54:490
243453280,6sleep10-21swapper/121:25:571
234459283,2sleep20-21swapper/221:20:212
193878281,3sleep1193911-21apt-get20:55:121
174198280,1sleep20-21swapper/220:35:002
14759880,5rtkit-daemon214-21plymouthd23:36:070
14759880,4rtkit-daemon529373-21/usr/sbin/munin00:25:250
14759880,4rtkit-daemon463008-21ssh23:41:302
14759880,4rtkit-daemon376934-21sed22:50:170
14759880,4rtkit-daemon22110-21packagekitd20:04:132
14759880,4rtkit-daemon214-21plymouthd22:20:202
14759880,4rtkit-daemon214-21plymouthd21:12:481
14759880,4rtkit-daemon214-21plymouthd19:26:552
14759880,4rtkit-daemon143442-21cut20:05:162
14759880,4rtkit-daemon1-21systemd22:57:530
14759880,4rtkit-daemon1-21systemd21:05:161
14759880,4rtkit-daemon1-21systemd20:35:342
14759880,4rtkit-daemon1-21systemd19:30:142
14759880,3rtkit-daemon247265-21cat21:30:160
14759880,3rtkit-daemon107502-21tr19:35:192
14759880,1rtkit-daemon0-21swapper/023:14:550
14759880,1rtkit-daemon0-21swapper/000:10:150
144836280,5sleep1146901-21kthreadcore20:05:191
110590280,4sleep0110779-21cat19:40:010
85785271,2sleep185818-21apt-get19:20:131
77117271,4sleep077135-21awk19:14:590
545955271,3sleep2546901-21irqstats00:35:182
543906271,3sleep1512318-21kworker/u16:1+nfsiod00:32:111
497119270,4sleep10-21swapper/100:05:111
479124270,5sleep2479130-21ssh23:51:252
464824270,3sleep1464867-21ssh23:45:121
440607271,1sleep20-21swapper/223:30:022
430626271,4sleep2430634-21ssh23:22:282
423962270,4sleep1423970-21ssh23:20:071
415416271,4sleep1415424-21ssh23:14:381
405611271,4sleep1405619-21ssh23:05:391
374498270,1sleep10-21swapper/122:48:281
357579270,5sleep20-21swapper/222:36:362
343441270,4sleep1343622-21sed22:30:181
335610271,3sleep1336529-21sed22:25:171
322722270,4sleep0324050-21memory22:15:180
316160273,2sleep1386-21hwrng22:10:211
262356271,3sleep0214-21plymouthd21:40:140
253633271,3sleep2253783-21df21:35:112
245902271,4sleep20-21swapper/221:30:152
234287271,3sleep0234370-21ntp_states21:20:190
219120271,4sleep20-21swapper/221:11:122
213084270,4sleep0213240-21diskstats21:10:140
14759870,4rtkit-daemon77273-21munin-node19:50:402
14759870,4rtkit-daemon720-21snmpd23:13:452
14759870,4rtkit-daemon431ktimers/219:05:322
14759870,3rtkit-daemon720-21snmpd22:45:080
14759870,3rtkit-daemon720-21snmpd20:27:382
14759870,3rtkit-daemon515-21gmain20:40:281
14759870,3rtkit-daemon481172-21diskstats23:55:130
14759870,3rtkit-daemon474-21systemd-logind20:51:431
14759870,3rtkit-daemon470736-21ssh23:45:370
14759870,3rtkit-daemon355085-21tr22:35:180
14759870,3rtkit-daemon214-21plymouthd23:30:010
14759870,3rtkit-daemon214-21plymouthd23:20:470
14759870,3rtkit-daemon214-21plymouthd19:41:222
14759870,3rtkit-daemon1-21systemd23:50:290
14759870,3rtkit-daemon1-21systemd23:26:500
14759870,3rtkit-daemon1-21systemd23:06:370
14759870,3rtkit-daemon1-21systemd23:01:280
14759870,3rtkit-daemon1-21systemd19:57:042
14759870,2rtkit-daemon214-21plymouthd21:02:081
14759870,2rtkit-daemon214-21plymouthd20:45:131
14759870,2rtkit-daemon214-21plymouthd19:16:062
14759870,2rtkit-daemon214-21plymouthd00:24:210
91523260,1sleep00-21swapper/019:21:170
76832260,1sleep10-21swapper/119:11:201
65124260,3sleep065307-21/usr/sbin/munin19:05:150
535204260,4sleep2535212-21ssh00:25:362
513224261,2sleep1513261-21apt-get00:15:131
505228260,1sleep10-21swapper/100:10:121
495761260,1sleep20-21swapper/200:02:362
495761260,1sleep20-21swapper/200:02:352
491144261,2sleep10-21swapper/100:00:181
491144261,2sleep10-21swapper/100:00:171
488509260,3sleep1488511-21ssh23:59:381
486906260,1sleep20-21swapper/223:55:512
478835260,3sleep1478843-21ssh23:50:481
464011261,3sleep10-21swapper/123:43:501
440063260,1sleep10-21swapper/123:29:571
421300260,3sleep1214-21plymouthd23:15:211
415870260,3sleep2415909-21apt-get23:15:102
385910261,3sleep1387903-21kthreadcore22:55:171
382884260,4sleep20-21swapper/222:54:072
351364260,3sleep1351520-21diskstats22:35:151
343626261,2sleep20-21swapper/222:30:182
310541260,1sleep00-21swapper/022:09:530
294568260,3sleep0294727-21df_inode22:00:140
261335260,4sleep2261355-21apt-get21:40:012
260079260,3sleep0260087-21ssh21:36:590
228831261,3sleep1228904-21systemd-run21:19:591
212384260,1sleep20-21swapper/221:08:422
205313261,2sleep20-21swapper/221:00:222
200163260,3sleep00-21swapper/021:00:120
199878260,1sleep00-21swapper/020:59:550
193404260,1sleep00-21swapper/020:52:140
187305260,1sleep20-21swapper/220:49:042
173925260,1sleep00-21swapper/020:31:300
167276260,4sleep0167416-21sed20:25:000
160748260,1sleep10-21swapper/120:16:571
154687260,1sleep00-21swapper/020:13:580
14759860,2rtkit-daemon214-21plymouthd22:40:452
135687260,3sleep1135702-21apt-get20:00:021
129378260,1sleep00-21swapper/019:54:510
122749260,1sleep10-21swapper/119:45:271
122749260,1sleep10-21swapper/119:45:261
116743260,1sleep10-21swapper/119:43:381
112263260,3sleep0113385-21cut19:40:170
104125260,1sleep10-21swapper/119:32:441
92270250,2sleep00-21swapper/019:25:140
77142250,2sleep10-21swapper/119:15:011
543455250,3sleep2543463-21ssh00:31:082
390281250,3sleep2390289-21ssh22:57:352
367498250,2sleep2367533-21apt-get22:45:132
333719250,3sleep00-21swapper/022:22:270
332096250,3sleep1327094-21/usr/sbin/munin22:20:191
276752250,3sleep10-21swapper/121:47:421
270035250,3sleep20-21swapper/221:45:092
252932250,3sleep10-21swapper/121:34:111
207256251,2sleep00-21swapper/021:05:160
187636250,2sleep20-21swapper/220:50:112
181038250,1sleep20-21swapper/220:43:422
175103250,2sleep0175136-21apt-get20:40:080
167566250,1sleep00-21swapper/020:25:370
156429251,2sleep00-21swapper/020:15:190
148747250,1sleep10-21swapper/120:10:021
141932250,3sleep00-21swapper/020:00:480
129687250,3sleep0129843-21diskstats19:55:160
104562250,2sleep1104595-21apt-get19:35:131
104139250,1sleep00-21swapper/019:32:550
80429240,2sleep081434-21kthreadcore19:15:160
454786240,1sleep10-21swapper/123:36:101
174501240,2sleep00-21swapper/020:35:470
142262240,1sleep00-21swapper/020:05:020
92065230,1sleep10-21swapper/119:25:071
193914230,1sleep20-21swapper/220:55:132
167417230,1sleep10-21swapper/120:25:021
161257230,1sleep10-21swapper/120:20:041
134936230,1sleep10-21swapper/119:55:251
123348230,1sleep10-21swapper/119:50:041
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional