You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-14 - 16:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Fri Aug 14, 2026 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
678199250,24cyclictest605-21avahi-daemon12:10:000
679699240,1cyclictest8125-21munin-run08:20:013
679399240,2cyclictest27248-21awk12:10:002
6796992323,0cyclictest0-21swapper/308:24:423
6796992321,1cyclictest313-21systemd-journal07:30:013
6796992321,1cyclictest0-21swapper/310:15:003
679699230,2cyclictest2893-21sh12:25:013
679699230,23cyclictest0-21swapper/309:14:403
679699230,22cyclictest313-21systemd-journal10:00:013
679699230,22cyclictest30906-21perf08:00:003
6793992322,1cyclictest32536-21diskmemload09:13:342
679399231,1cyclictest13178-21latency_hist10:35:002
679399230,2cyclictest32556-21awk09:10:012
679399230,1cyclictest30906-21perf08:00:002
6785992323,0cyclictest3912-21apt-get08:14:431
6785992322,1cyclictest8128-21awk08:20:011
678599230,23cyclictest0-21swapper/109:11:031
678599230,22cyclictest12674-21apt-get11:44:431
678599230,22cyclictest10768-21apt10:30:001
678199230,2cyclictest313-21systemd-journal09:25:000
6796992222,0cyclictest16221-21apt-get10:44:433
6796992220,1cyclictest0-21swapper/309:04:433
679699220,21cyclictest27241-21dpkg12:10:003
679699220,21cyclictest11535-21awk07:20:013
679699220,21cyclictest0-21swapper/310:34:423
679699220,21cyclictest0-21swapper/310:29:423
679699220,1cyclictest25822-21apt-get11:04:443
679399220,21cyclictest23526-21apt-get08:54:422
679399220,21cyclictest20648-21apt-get11:59:422
679399220,21cyclictest0-21swapper/212:15:022
679399220,21cyclictest0-21swapper/211:44:422
679399220,21cyclictest0-21swapper/209:54:422
679399220,21cyclictest0-21swapper/208:44:432
679399220,1cyclictest606-21dbus-daemon08:10:012
679399220,1cyclictest19654-21latency_hist11:55:002
678599220,21cyclictest31018-21apt-get10:09:421
678599220,21cyclictest3060-21apt-get11:24:411
678599220,21cyclictest0-21swapper/110:14:431
678599220,1cyclictest25550-21munin-run09:55:011
6781992221,1cyclictest22898-21latency_hist08:50:000
6781992220,1cyclictest27969-21cron10:00:010
678199220,22cyclictest0-21swapper/009:11:590
678199220,21cyclictest62550irq/127-eno108:44:430
678199220,21cyclictest0-21swapper/008:54:420
678199220,21cyclictest0-21swapper/008:30:000
6796992121,0cyclictest0-21swapper/311:55:023
6796992121,0cyclictest0-21swapper/307:24:423
679699210,20cyclictest28305-21apt-get12:14:433
679699210,20cyclictest0-21swapper/310:49:423
679699210,20cyclictest0-21swapper/309:34:433
679699210,20cyclictest0-21swapper/309:15:103
679699210,20cyclictest0-21swapper/308:34:423
679699210,0cyclictest5457-21apt-get11:29:423
679699210,0cyclictest0-21swapper/308:09:433
6793992119,1cyclictest24856-21munin-run12:05:002
679399210,21cyclictest0-21swapper/208:24:422
679399210,20cyclictest30154-21apt09:05:012
679399210,20cyclictest0-21swapper/210:49:432
679399210,0cyclictest0-21swapper/210:55:012
6785992121,0cyclictest0-21swapper/109:39:431
6785992120,1cyclictest21130-21apt-get08:49:421
678599210,21cyclictest0-21swapper/107:55:001
678599210,20cyclictest0-21swapper/112:09:441
678599210,20cyclictest0-21swapper/107:34:451
678599210,1cyclictest28266-21apt-get11:09:411
678599210,0cyclictest25924-21apt-get08:59:461
6781992121,0cyclictest0-21swapper/008:14:420
6781992121,0cyclictest0-21swapper/008:04:420
6781992120,0cyclictest0-21swapper/011:54:420
6781992119,1cyclictest5287-21latency_hist12:30:010
678199210,21cyclictest0-21swapper/010:25:020
678199210,20cyclictest29120-21apt-get07:59:430
678199210,20cyclictest21010-21apt-get10:54:420
678199210,20cyclictest0-21swapper/012:34:430
678199210,0cyclictest19630-21apt-get11:55:020
678199210,0cyclictest1506-21apt-get08:09:430
678199210,0cyclictest0-21swapper/008:20:020
6796992020,0cyclictest0-21swapper/312:04:423
6796992020,0cyclictest0-21swapper/311:14:423
6796992020,0cyclictest0-21swapper/310:59:433
6796992020,0cyclictest0-21swapper/310:04:413
6796992020,0cyclictest0-21swapper/309:54:423
6796992020,0cyclictest0-21swapper/309:44:423
6796992020,0cyclictest0-21swapper/308:14:423
6796992019,1cyclictest26673-21runrttasks07:54:413
6796992018,1cyclictest903-21awk08:05:003
679699200,19cyclictest20524-21munin-run08:45:003
679699200,0cyclictest0-21swapper/310:39:433
6793992020,0cyclictest0-21swapper/211:19:422
6793992020,0cyclictest0-21swapper/211:09:422
6793992020,0cyclictest0-21swapper/210:59:442
6793992020,0cyclictest0-21swapper/210:19:422
6793992020,0cyclictest0-21swapper/209:59:432
6793992020,0cyclictest0-21swapper/208:14:432
6793992019,1cyclictest18127-21basename08:40:002
6793992019,1cyclictest0-21swapper/211:49:432
6793992019,1cyclictest0-21swapper/210:39:422
6793992019,1cyclictest0-21swapper/208:49:422
6793992019,0cyclictest0-21swapper/211:04:442
6793992018,2cyclictest8011-21dpkg10:25:002
679399200,0cyclictest3179-21perf10:15:002
679399200,0cyclictest28625-21apt-get10:04:412
679399200,0cyclictest0-21swapper/212:24:442
679399200,0cyclictest0-21swapper/209:44:422
6785992020,0cyclictest0-21swapper/112:24:441
6785992020,0cyclictest0-21swapper/109:44:421
6785992020,0cyclictest0-21swapper/109:15:051
6785992020,0cyclictest0-21swapper/107:39:431
6785992019,0cyclictest31534-21apt-get08:04:421
6785992017,2cyclictest11537-21latency_hist07:20:011
678599200,19cyclictest30070-21turbostat.cron12:15:001
678599200,19cyclictest0-21swapper/112:04:421
678599200,0cyclictest0-21swapper/110:59:441
6781992020,0cyclictest31116-21apt-get12:19:440
6781992020,0cyclictest0-21swapper/012:14:430
6781992020,0cyclictest0-21swapper/011:24:420
6781992020,0cyclictest0-21swapper/011:14:420
6781992020,0cyclictest0-21swapper/011:04:440
6781992020,0cyclictest0-21swapper/010:04:410
6781992020,0cyclictest0-21swapper/009:54:420
6781992020,0cyclictest0-21swapper/009:39:430
6781992020,0cyclictest0-21swapper/009:29:440
6781992020,0cyclictest0-21swapper/009:19:410
6781992020,0cyclictest0-21swapper/008:39:440
6781992020,0cyclictest0-21swapper/007:44:410
6781992019,1cyclictest7234-21ls11:30:010
678199200,0cyclictest0-21swapper/007:39:430
6796991919,0cyclictest3517-21apt-get12:29:433
6796991919,0cyclictest0-21swapper/310:09:423
6796991919,0cyclictest0-21swapper/307:49:423
6796991919,0cyclictest0-21swapper/307:44:413
6796991918,1cyclictest10127-21latency_hist12:40:003
6796991918,1cyclictest0-21swapper/310:19:423
6796991918,1cyclictest0-21swapper/308:39:443
6793991919,0cyclictest0-21swapper/210:09:422
6793991919,0cyclictest0-21swapper/207:54:412
6793991918,1cyclictest0-21swapper/207:14:422
6793991917,1cyclictest6311-21apt-get08:19:442
6793991917,1cyclictest32431-21grep11:15:002
6785991919,0cyclictest9130-21apt-get08:24:421
6785991919,0cyclictest7864-21apt-get11:34:421
6785991919,0cyclictest6213-21apt-get10:24:431
6785991919,0cyclictest0-21swapper/112:29:431
6785991919,0cyclictest0-21swapper/111:19:421
6785991919,0cyclictest0-21swapper/111:04:441
6785991919,0cyclictest0-21swapper/110:54:421
6785991919,0cyclictest0-21swapper/109:34:431
6785991919,0cyclictest0-21swapper/109:29:441
6785991918,1cyclictest13799-21apt-get10:39:431
678599190,19cyclictest0-21swapper/107:44:411
678599190,0cyclictest26158-21apt-get09:59:431
6781991919,0cyclictest0-21swapper/010:19:420
6781991919,0cyclictest0-21swapper/008:59:460
6781991917,1cyclictest11520-21awk07:20:010
6796991818,0cyclictest597-21apt-get11:19:413
6796991818,0cyclictest0-21swapper/309:24:423
6796991817,1cyclictest16968-21apt-get07:34:453
6796991817,1cyclictest13532-21perf09:30:003
6796991817,1cyclictest0-21swapper/312:34:433
6793991818,0cyclictest0-21swapper/209:34:432
6793991818,0cyclictest0-21swapper/208:29:422
6793991818,0cyclictest0-21swapper/207:49:422
6793991818,0cyclictest0-21swapper/207:19:422
6793991817,0cyclictest0-21swapper/209:19:422
6793991816,1cyclictest27745-21turbostat09:00:012
6785991818,0cyclictest6775-21cyclictest08:00:001
6785991818,0cyclictest12170-21apt-get07:24:421
6785991818,0cyclictest0-21swapper/108:54:421
6785991818,0cyclictest0-21swapper/108:09:431
6785991816,1cyclictest16335-21perf07:30:011
6781991818,0cyclictest0-21swapper/010:44:430
6781991818,0cyclictest0-21swapper/009:04:430
6781991817,0cyclictest0-21swapper/008:34:420
6781991816,1cyclictest0-21swapper/011:35:010
6796991717,0cyclictest30780-21apt-get09:09:413
6796991717,0cyclictest0-21swapper/311:54:423
6796991717,0cyclictest0-21swapper/311:44:423
6796991717,0cyclictest0-21swapper/311:24:423
6796991717,0cyclictest0-21swapper/308:54:423
6785991717,0cyclictest13923-21apt-get08:34:421
6785991717,0cyclictest0-21swapper/111:55:021
6785991717,0cyclictest0-21swapper/110:44:431
6785991717,0cyclictest0-21swapper/110:34:421
6785991717,0cyclictest0-21swapper/108:44:431
6785991716,1cyclictest8322-21apt-get12:39:431
678599170,17cyclictest0-21swapper/107:49:421
6781991717,0cyclictest18973-21apt-get09:44:420
6781991717,0cyclictest0-21swapper/010:39:420
6781991717,0cyclictest0-21swapper/009:09:410
6781991713,3cyclictest793-21lldpd07:10:180
678199171,15cyclictest0-21swapper/011:44:050
678199170,17cyclictest0-21swapper/007:29:450
678199170,16cyclictest0-21swapper/011:39:420
678199170,16cyclictest0-21swapper/009:34:430
6796991616,0cyclictest0-21swapper/311:37:273
6796991616,0cyclictest0-21swapper/308:59:463
6796991614,1cyclictest8012-21http10:25:003
6796991614,1cyclictest0-21swapper/307:14:423
679699160,15cyclictest30037-21latency_hist11:10:003
679699160,15cyclictest0-21swapper/308:30:003
679699160,0cyclictest0-21swapper/310:54:423
6793991616,0cyclictest0-21swapper/209:39:432
6793991616,0cyclictest0-21swapper/207:29:452
6793991616,0cyclictest0-21swapper/207:24:422
6793991615,1cyclictest11138-21perf09:25:002
6793991614,1cyclictest0-21swapper/211:39:472
6785991615,0cyclictest0-21swapper/108:29:421
6785991614,1cyclictest18506-21taskset10:48:441
6785991614,1cyclictest0-21swapper/112:34:521
678599160,11cyclictest3794-21apt-get10:19:421
6781991616,0cyclictest1386-21apt-get10:14:430
6781991616,0cyclictest0-21swapper/011:49:430
6781991616,0cyclictest0-21swapper/011:19:420
6781991616,0cyclictest0-21swapper/010:34:420
6781991616,0cyclictest0-21swapper/008:19:440
6781991616,0cyclictest0-21swapper/007:34:450
6781991614,1cyclictest324-21perf10:10:000
6781991614,1cyclictest21275-21taskset09:48:580
678199160,1cyclictest30055-21munin-run11:10:000
678199160,15cyclictest27190-21tune2fs07:54:430
678199160,15cyclictest0-21swapper/010:24:480
6796991515,0cyclictest0-21swapper/311:48:543
6796991514,1cyclictest0-21swapper/311:35:013
6796991514,1cyclictest0-21swapper/309:39:433
679699150,14cyclictest0-21swapper/312:19:503
6793991515,0cyclictest0-21swapper/212:34:432
6793991515,0cyclictest0-21swapper/211:29:422
6793991515,0cyclictest0-21swapper/209:49:432
6793991514,1cyclictest0-21swapper/212:39:502
6793991513,1cyclictest11762-21apt-get09:29:452
6793991513,1cyclictest0-21swapper/208:04:422
679399150,14cyclictest0-21swapper/212:10:022
6785991515,0cyclictest0-21swapper/110:04:411
6785991515,0cyclictest0-21swapper/109:04:431
6781991514,1cyclictest24114-21chrt07:48:020
6781991514,1cyclictest23064-21apt-get12:04:420
6781991514,1cyclictest0-21swapper/007:21:130
679699140,14cyclictest0-21swapper/308:45:163
679699140,14cyclictest0-21swapper/307:35:033
679699140,0cyclictest0-21swapper/309:45:273
6793991414,0cyclictest0-21swapper/210:25:362
679399140,14cyclictest0-21swapper/208:33:172
679399140,14cyclictest0-21swapper/207:40:142
679399140,14cyclictest0-21swapper/207:35:072
679399140,14cyclictest0-21swapper/207:30:262
679399140,0cyclictest0-21swapper/211:31:172
679399140,0cyclictest0-21swapper/211:20:112
679399140,0cyclictest0-21swapper/210:40:412
6785991414,0cyclictest0-21swapper/111:51:131
6785991414,0cyclictest0-21swapper/111:35:251
678599140,14cyclictest0-21swapper/112:15:161
678599140,14cyclictest0-21swapper/107:10:341
678599140,0cyclictest0-21swapper/111:45:251
678599140,0cyclictest0-21swapper/109:45:331
678599140,0cyclictest0-21swapper/108:35:031
6781991414,0cyclictest0-21swapper/012:21:280
678199140,14cyclictest0-21swapper/010:45:210
678199140,0cyclictest0-21swapper/012:36:150
678199140,0cyclictest0-21swapper/010:56:300
6793991313,0cyclictest0-21swapper/212:28:502
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional