You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-28 - 23:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot8s.osadl.org (updated Sun Dec 28, 2025 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4347159912670,1263cyclictest6962322sleep310:29:553
4347159911840,1181cyclictest8002632sleep311:50:013
4347159910721,1066cyclictest663752-21sleep10:05:013
434715996491,644cyclictest8325122chrt12:15:013
434715993110,307cyclictest521058-21turbostat08:19:553
434715992421,1cyclictest0-21swapper/308:50:163
434715992313,1cyclictest0-21swapper/308:38:593
434715992213,0cyclictest0-21swapper/310:36:203
434715992211,1cyclictest0-21swapper/307:57:413
434715992112,0cyclictest0-21swapper/311:17:063
434715992017,1cyclictest0-21swapper/307:15:013
434715992011,0cyclictest0-21swapper/309:52:223
43471599198,8cyclictest449715-21turbostat07:20:003
434715991912,0cyclictest0-21swapper/307:32:073
434715991911,0cyclictest0-21swapper/310:06:573
5859002181,7sleep0585902-21sshd09:03:350
43471599188,7cyclictest560220-21turbostat08:45:003
434715991715,1cyclictest0-21swapper/312:25:013
434715991714,1cyclictest0-21swapper/311:30:003
434715991714,1cyclictest0-21swapper/309:20:233
43471599171,12cyclictest813234-21taskset12:00:153
434715991710,4cyclictest787110-21turbostat11:40:003
43471599165,8cyclictest696255-21turbostat10:34:543
434715991613,1cyclictest0-21swapper/311:02:243
434715991613,1cyclictest0-21swapper/310:45:223
434715991613,1cyclictest0-21swapper/309:50:003
7875632151,5sleep1787763-21hddtemp_smartct11:40:141
43471599155,7cyclictest6125352sleep309:25:143
434715991513,1cyclictest0-21swapper/308:08:073
434715991512,1cyclictest0-21swapper/307:45:163
434715991512,1cyclictest0-21swapper/307:24:383
43471599151,11cyclictest547325-21turbostat08:35:003
43471599151,10cyclictest625010-21turbostat09:35:003
43471599150,12cyclictest676593-21chrt10:14:573
43471599150,12cyclictest631476-21turbostat09:40:013
301798150,6rtkit-daemon657739-21diskstats10:00:152
43471599144,7cyclictest799903-21taskset11:48:303
43471599144,7cyclictest715848-21taskset10:44:593
434715991412,1cyclictest0-21swapper/309:17:403
434715991412,1cyclictest0-21swapper/308:56:423
434715991412,1cyclictest0-21swapper/308:56:413
43471599141,10cyclictest754158-21taskset11:10:273
43471599141,10cyclictest599153-21chrt09:14:433
43471599141,10cyclictest579870-21taskset09:00:123
301798140,4rtkit-daemon832527-21/usr/sbin/munin12:15:142
8644372131,9sleep0782924-21kworker/0:2+events12:38:350
43471599131,9cyclictest864365-21taskset12:37:373
43471599131,9cyclictest807132-21taskset11:55:153
43471599131,9cyclictest741917-21taskset11:05:093
43471599131,9cyclictest677100-21taskset10:15:023
43471599131,9cyclictest631720-21taskset09:40:033
43471599131,9cyclictest540124-21chrt08:25:223
43471599131,9cyclictest501928-21taskset08:00:143
43471599131,9cyclictest494839-21taskset07:50:423
43471599131,9cyclictest481971-21taskset07:40:283
43471599131,9cyclictest462314-21taskset07:26:263
434715991312,0cyclictest0-21swapper/312:32:473
434715991312,0cyclictest0-21swapper/310:22:273
434715991311,0cyclictest0-21swapper/312:06:153
434715991310,1cyclictest0-21swapper/311:22:203
434715991310,1cyclictest0-21swapper/311:22:193
434715991310,1cyclictest0-21swapper/309:05:203
43471599130,10cyclictest734950-21chrt10:57:013
43471599130,10cyclictest651072-21chrt09:55:023
43471599130,10cyclictest520840-21taskset08:12:323
43471599130,10cyclictest475457-21chrt07:36:183
43471599125,5cyclictest7931912sleep311:40:243
43471599121,9cyclictest845411-21taskset12:25:043
43471599121,9cyclictest722531-21taskset10:50:033
434715991210,0cyclictest0-21swapper/312:11:213
43471599120,9cyclictest565557-21taskset08:45:193
43471599120,10cyclictest774163-21taskset11:30:033
43471599120,10cyclictest528268-21chrt08:20:073
301798120,7rtkit-daemon761089-21cat11:20:002
8000212111,6sleep1800039-21apt11:50:011
4343192110,3sleep30-21swapper/307:06:543
301798110,5rtkit-daemon501925-21apt-get08:00:140
301798110,4rtkit-daemon430-21avahi-daemon11:06:462
301798110,3rtkit-daemon3200908-21packagekitd11:10:092
5428822101,6sleep10-21swapper/108:30:221
301798100,6rtkit-daemon492-21gmain10:19:492
301798100,6rtkit-daemon3205-21sendmail-mta07:46:380
301798100,6rtkit-daemon2904-21cron09:14:012
301798100,5rtkit-daemon766424-21memory11:20:182
301798100,5rtkit-daemon766424-21memory11:20:182
301798100,5rtkit-daemon500771-21ntp_states07:55:220
301798100,5rtkit-daemon450181-21df07:20:290
301798100,5rtkit-daemon448-21wpa_supplicant07:10:120
301798100,3rtkit-daemon636-21snmpd12:35:512
831198291,5sleep1831353-21/usr/sbin/munin12:10:191
728104291,6sleep0728349-21uptime10:50:250
724035290,6sleep2725927-21grep10:50:192
677114291,4sleep1677147-21apt-get10:15:121
664373291,6sleep2664534-21cut10:05:152
612807291,4sleep1613803-21irqstats09:25:171
612092295,1sleep20-21swapper/209:25:012
560197291,5sleep0560215-21munin-run08:45:000
443674290,6sleep2443698-21/usr/sbin/munin07:15:152
441263290,5sleep1441675-21ntp_states07:15:031
30179890,4rtkit-daemon816204-21cut12:00:202
30179890,4rtkit-daemon562188-21cut08:45:162
30179890,4rtkit-daemon516851-21cut08:10:161
30179890,4rtkit-daemon394707-21kworker/2:1+events11:00:212
30179890,1rtkit-daemon0-21swapper/108:17:301
780874280,4sleep1780394-21apt-get11:35:011
766843281,4sleep1767087-21users11:20:241
766843281,4sleep1767087-21users11:20:231
696236281,4sleep2696269-21basename10:29:592
631918281,4sleep1632013-21fschecks_time09:40:141
599433281,3sleep2599466-21apt-get09:15:112
539975280,4sleep1540046-21ntp_states08:25:211
462850281,3sleep0462883-21apt-get07:30:120
443494281,3sleep0443527-21apt-get07:15:140
427875280,4sleep2427891-21apt-get07:05:012
30179880,5rtkit-daemon430-21avahi-daemon11:25:432
30179880,5rtkit-daemon3205-21sendmail-mta12:11:242
30179880,4rtkit-daemon702097-21ntp_states10:30:212
30179880,4rtkit-daemon636-21snmpd12:30:052
30179880,4rtkit-daemon636-21snmpd11:51:402
30179880,4rtkit-daemon636-21snmpd11:41:132
30179880,4rtkit-daemon636-21snmpd09:40:112
30179880,4rtkit-daemon636-21snmpd07:37:140
30179880,4rtkit-daemon492-21gmain08:05:240
30179880,4rtkit-daemon441235-21munin-node12:26:352
30179880,4rtkit-daemon441235-21munin-node11:32:522
30179880,4rtkit-daemon441235-21munin-node10:55:462
30179880,4rtkit-daemon441235-21munin-node10:35:512
30179880,4rtkit-daemon441235-21munin-node09:33:002
30179880,4rtkit-daemon3205-21sendmail-mta10:48:032
30179880,4rtkit-daemon3205-21sendmail-mta07:50:580
30179880,4rtkit-daemon3200908-21packagekitd11:37:082
30179880,4rtkit-daemon2904-21cron09:40:012
30179880,1rtkit-daemon0-21swapper/209:55:372
30179880,1rtkit-daemon0-21swapper/209:51:302
30179880,1rtkit-daemon0-21swapper/209:25:362
30179880,1rtkit-daemon0-21swapper/007:27:240
807714273,2sleep00-21swapper/011:55:160
801789270,5sleep1803812-21tr11:50:161
736461271,3sleep0737327-21kthreadcore11:00:200
702122271,3sleep0702247-21python310:30:230
685113270,4sleep2686983-21grep10:20:182
671247270,5sleep1672120-21kthreadcore10:10:191
651084271,4sleep00-21swapper/009:55:120
638687270,5sleep1639678-21kernelversion09:45:151
624991270,2sleep00-21swapper/009:35:000
618813271,2sleep1618846-21apt-get09:30:121
542135270,5sleep0542881-21cat08:30:210
456954271,3sleep10-21swapper/107:25:151
30179870,4rtkit-daemon667-21lldpd07:07:260
30179870,4rtkit-daemon638-21ntpd12:21:122
30179870,4rtkit-daemon636-21snmpd07:41:040
30179870,4rtkit-daemon3200908-21packagekitd08:09:581
30179870,3rtkit-daemon638-21ntpd09:00:462
30179870,3rtkit-daemon638-21ntpd08:35:352
30179870,3rtkit-daemon636-21snmpd12:05:212
30179870,3rtkit-daemon636-21snmpd11:55:562
30179870,3rtkit-daemon636-21snmpd10:40:302
30179870,3rtkit-daemon636-21snmpd09:47:212
30179870,3rtkit-daemon570340-21kthreadcore08:50:172
30179870,3rtkit-daemon441235-21munin-node11:48:212
30179870,3rtkit-daemon441235-21munin-node10:11:502
30179870,3rtkit-daemon441235-21munin-node08:58:372
30179870,3rtkit-daemon441235-21munin-node08:58:362
30179870,3rtkit-daemon441235-21munin-node08:20:231
30179870,3rtkit-daemon3205-21sendmail-mta09:05:542
30179870,3rtkit-daemon2904-21cron08:42:002
851921260,3sleep0852070-21df_inode12:30:140
808589261,3sleep1806733-21/usr/sbin/munin11:55:171
800877261,3sleep0801785-21kthreadcore11:50:150
799967260,1sleep00-21swapper/011:49:190
780089260,0sleep00-21swapper/011:31:160
773188260,3sleep0773297-21find11:25:230
716107261,2sleep10-21swapper/110:45:141
715850260,3sleep0716075-21date10:45:000
704695260,3sleep1706707-21grep10:35:191
690495260,4sleep1691410-21cut10:25:141
683344260,3sleep0683524-21sed10:20:000
665471261,2sleep0667311-21kthreadcore10:05:180
644648261,2sleep10-21swapper/109:50:131
625285260,3sleep1625382-21tr09:35:131
611749260,1sleep10-21swapper/109:20:351
607091260,4sleep0608292-21cut09:20:180
605594261,3sleep1636-21snmpd09:19:111
600934261,2sleep00-21swapper/009:15:170
592472263,1sleep0221rcuc/009:10:000
578582261,2sleep10-21swapper/108:55:201
578582261,2sleep10-21swapper/108:55:191
560491260,3sleep1560647-21diskstats08:45:131
534746260,3sleep0534889-21df08:25:120
521964260,3sleep2522615-21cut08:15:172
519338261,2sleep00-21swapper/008:10:190
510983260,4sleep2513121-21grep08:05:202
490447260,4sleep2491765-21grep07:50:172
468135260,3sleep1468191-21ntp_states07:30:201
456121260,1sleep10-21swapper/107:24:351
854561250,2sleep10-21swapper/112:30:191
851381250,1sleep00-21swapper/012:26:490
838368250,1sleep10-21swapper/112:15:401
833994251,2sleep00-21swapper/012:15:200
821441251,2sleep00-21swapper/012:05:180
789029251,2sleep00-21swapper/011:40:170
786875250,1sleep00-21swapper/011:37:140
774956250,3sleep1775842-21cat11:30:171
767711250,2sleep10-21swapper/111:25:121
767412250,1sleep00-21swapper/011:24:280
767412250,1sleep00-21swapper/011:24:270
760799250,1sleep10-21swapper/111:17:431
760746250,1sleep00-21swapper/011:17:010
744609251,2sleep00-21swapper/011:05:190
737330251,2sleep10-21swapper/111:00:201
735092250,0sleep00-21swapper/010:58:500
727825250,2sleep1727884-21ntp_states10:50:221
709648250,2sleep10-21swapper/110:40:121
709062250,1sleep00-21swapper/010:36:030
696755250,1sleep10-21swapper/110:30:121
689594250,1sleep00-21swapper/010:22:210
663555250,1sleep10-21swapper/110:02:501
650586250,1sleep00-21swapper/009:51:520
633187251,2sleep00-21swapper/009:40:180
618208250,2sleep0618210-21sshd09:25:360
592468250,1sleep10-21swapper/109:09:571
572833250,1sleep00-21swapper/008:51:380
566466250,1sleep00-21swapper/008:47:320
559893250,1sleep10-21swapper/108:41:041
547754250,1sleep10-21swapper/108:35:161
547293250,1sleep20-21swapper/208:34:522
536169250,3sleep2537950-21cut08:25:182
534434250,1sleep20-21swapper/208:24:472
507428250,3sleep1507593-21timerwakeupswit08:00:251
495425250,1sleep10-21swapper/107:55:091
495134250,1sleep10-21swapper/107:54:321
488400250,1sleep20-21swapper/207:45:402
476121250,2sleep20-21swapper/207:40:122
474981250,2sleep10-21swapper/107:35:251
464522251,2sleep20-21swapper/207:30:172
456072250,1sleep20-21swapper/207:23:562
440988250,1sleep20-21swapper/207:13:582
863699240,2sleep10-21swapper/112:35:241
845424240,1sleep10-21swapper/112:25:151
845152240,3sleep10-21swapper/112:24:501
844262241,1sleep00-21swapper/012:20:200
831513240,1sleep00-21swapper/012:10:220
819050240,3sleep00-21swapper/012:00:340
748334240,1sleep00-21swapper/011:10:120
734079240,2sleep1734251-21strings10:55:191
721950240,3sleep00-21swapper/010:45:410
696176240,3sleep00-21swapper/010:29:130
676372240,3sleep00-21swapper/010:12:060
663666240,3sleep00-21swapper/010:04:170
638209240,3sleep00-21swapper/009:45:100
625249240,2sleep0625282-21apt-get09:35:120
595157240,2sleep10-21swapper/109:10:181
594009241,1sleep00-21swapper/009:10:170
585288240,1sleep10-21swapper/109:00:231
553427240,3sleep00-21swapper/008:35:590
534380240,3sleep00-21swapper/008:24:040
523808240,2sleep0525864-21kthreadcore08:15:190
516023240,1sleep20-21swapper/208:10:162
507595240,1sleep20-21swapper/208:00:262
496411240,2sleep2497411-21kthreadcore07:55:172
482001240,3sleep10-21swapper/107:40:511
457911240,2sleep2459922-21kthreadcore07:25:172
440801240,1sleep10-21swapper/107:11:331
428646240,1sleep10-21swapper/107:05:161
819847230,1sleep10-21swapper/112:05:151
813197230,1sleep10-21swapper/112:00:151
749315230,1sleep10-21swapper/111:10:181
741664230,1sleep10-21swapper/111:05:001
683525230,1sleep10-21swapper/110:20:011
651109230,1sleep10-21swapper/109:55:131
570237230,1sleep10-21swapper/108:50:191
487981230,1sleep10-21swapper/107:45:231
663965220,1sleep10-21swapper/110:05:031
573337220,1sleep00-21swapper/008:55:010
573337220,1sleep00-21swapper/008:55:010
469535220,1sleep20-21swapper/207:35:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional