You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-29 - 15:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Wed Apr 29, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1178854997253,17cyclictest1259570-21apt-get08:26:190
1178859995847,9cyclictest1487572-21ntpq12:16:141
1178854995835,20cyclictest1508535-21latency_hist12:40:010
1178859995750,5cyclictest1294564-21kworker/u8:1+flush-8:010:01:211
1178859995345,6cyclictest1453876-21kworker/u8:3+flush-8:012:21:151
1178859995246,5cyclictest1354898-21kworker/u8:3+flush-8:010:21:201
1178859995244,6cyclictest1344534-21kworker/u8:2+flush-8:011:36:191
1178854995135,14cyclictest1294875-21apt-get09:04:590
14579682500,4chrt0-21swapper/111:46:161
14579682500,4chrt0-21swapper/111:46:161
1178859995045,4cyclictest1453876-21kworker/u8:3+events_unbound12:31:221
1178861994940,6cyclictest1508531-21turbostat.cron12:40:002
1178859994945,3cyclictest1344534-21kworker/u8:2+events_unbound10:26:181
1178859994944,4cyclictest3956362-21kworker/u8:3+events_unbound07:21:181
1178859994944,3cyclictest1194995-21kworker/u8:0+flush-8:009:41:071
1178859994943,4cyclictest1399650-21kworker/u8:0+events_unbound11:16:181
1178854994934,13cyclictest280-21systemd-journal09:48:570
1178859994844,3cyclictest1453876-21kworker/u8:3+events_unbound12:11:091
1178859994843,3cyclictest1354898-21kworker/u8:3+events_unbound10:56:241
1178859994842,4cyclictest1453876-21kworker/u8:3+flush-8:012:06:161
1178859994842,4cyclictest1194995-21kworker/u8:0+flush-8:009:51:161
1178859994840,6cyclictest1230282-21latency_hist08:00:011
1178854994831,15cyclictest1240769-21apt-get08:11:030
1178859994743,3cyclictest1194995-21kworker/u8:0+flush-8:007:26:191
1178859994742,4cyclictest1310186-21kworker/u8:3+events_unbound09:31:201
1178859994742,4cyclictest1194995-21kworker/u8:0+events_unbound10:10:011
1178859994740,5cyclictest1205367-21kworker/u8:3+flush-8:008:06:201
1178859994739,6cyclictest1194995-21kworker/u8:0+events_unbound09:16:151
1178859994642,3cyclictest1488232-21kworker/u8:1+events_unbound12:36:191
1178859994641,4cyclictest1194995-21kworker/u8:0+flush-8:007:51:151
1178859994640,5cyclictest1245380-21kworker/u8:1+events_unbound08:26:151
1178859994639,5cyclictest1498423-21latency_hist12:30:011
1178859994639,5cyclictest1344534-21kworker/u8:2+events_unbound10:46:041
1178854994638,5cyclictest1220362-21latency_hist07:50:010
1178859994541,3cyclictest1205367-21kworker/u8:3+flush-8:008:11:211
1178859994540,4cyclictest1344534-21kworker/u8:2+events_unbound11:06:091
1178859994540,4cyclictest1310186-21kworker/u8:3+flush-8:009:21:051
1178859994540,3cyclictest1472800-21ntpq12:01:161
1178859994539,4cyclictest1414513-21kworker/u8:1+events_unbound11:51:061
1178859994538,5cyclictest1414513-21kworker/u8:1+flush-8:011:56:171
1178859994438,5cyclictest1245380-21kworker/u8:1+events_unbound08:51:061
1178859994438,4cyclictest1344534-21kworker/u8:2+flush-8:009:56:211
1178859994438,4cyclictest1310186-21kworker/u8:3+events_unbound09:26:071
1178859994437,5cyclictest238201-21kworker/u8:2+flush-8:008:01:181
1178854994437,5cyclictest1399650-21kworker/u8:0+events_unbound11:01:150
1178854994432,9cyclictest280-21systemd-journal12:20:000
1178854994326,15cyclictest1472690-21needreboot12:01:140
1178859994237,4cyclictest1178970-21kworker/u8:1+events_unbound07:11:211
1178859994236,5cyclictest238201-21kworker/u8:2+flush-8:008:46:141
1178859994236,4cyclictest1194995-21kworker/u8:0+events_unbound08:31:051
1178859994236,4cyclictest1194995-21kworker/u8:0+events_unbound08:31:041
1178859994236,4cyclictest1178970-21kworker/u8:1+events_unbound07:16:051
1178854994230,9cyclictest1191191-21diskstats07:21:070
1178854994225,15cyclictest1255312-21systemd-run08:25:000
1178861994131,8cyclictest1478570-21turbostat.cron12:10:012
1178861994130,8cyclictest1270127-21awk08:40:002
1178859994137,3cyclictest1439293-21kworker/u8:0+flush-8:011:41:221
1178859994137,3cyclictest1399650-21kworker/u8:0+flush-8:011:11:101
1178859994136,3cyclictest1245380-21kworker/u8:1+flush-8:008:41:091
1178859994135,4cyclictest1310186-21kworker/u8:3+flush-8:009:36:111
1178859994133,6cyclictest280-21systemd-journal10:31:191
1178859994133,6cyclictest1200833-21/usr/sbin/munin07:31:161
117885499413,30cyclictest0-21swapper/010:31:030
117885499412,26cyclictest0-21swapper/012:34:210
117885499411,23cyclictest1235721-21runrttasks08:05:110
117885499411,22cyclictest589-21runrttasks09:36:040
11877782400,2sleep2371rcuc/207:16:092
1178859994035,4cyclictest1399650-21kworker/u8:0+events_unbound11:01:171
1178859994034,5cyclictest1374132-21kworker/u8:0+flush-8:010:36:151
1178859994034,4cyclictest1414513-21kworker/u8:1+events_unbound11:31:221
1178859994033,5cyclictest1280021-21kworker/u8:3+flush-8:008:56:151
1178854994027,10cyclictest280-21systemd-journal10:25:010
1178854994024,14cyclictest0-21swapper/009:15:000
117885499402,29cyclictest0-21swapper/008:51:020
11938032390,5sleep375-21kworker/3:1+mm_percpu_wq07:21:133
1178859993935,3cyclictest1194995-21kworker/u8:0+flush-8:009:11:561
1178859993933,5cyclictest1194995-21kworker/u8:0+events_unbound08:21:181
1178854993933,4cyclictest1194995-21kworker/u8:0+flush-8:009:30:010
117885499393,28cyclictest0-21swapper/011:06:000
1178854993925,12cyclictest1210474-21cron07:40:000
1178854993923,14cyclictest1448567-21unixbench_singl11:36:210
117885499392,24cyclictest0-21swapper/011:48:310
117885499392,24cyclictest0-21swapper/011:48:310
1178854993922,12cyclictest0-21swapper/010:16:070
117885499391,22cyclictest589-21runrttasks10:46:190
117885499391,22cyclictest589-21runrttasks07:26:020
1178859993834,3cyclictest1344534-21kworker/u8:2+flush-8:010:51:201
1178859993833,4cyclictest1194995-21kworker/u8:0+flush-8:009:01:111
117885499384,26cyclictest0-21swapper/009:21:030
117885499383,27cyclictest0-21swapper/011:16:020
117885499383,27cyclictest0-21swapper/010:56:040
117885499383,26cyclictest0-21swapper/009:41:020
117885499382,27cyclictest0-21swapper/010:06:140
117885499382,22cyclictest0-21swapper/007:19:240
117885499382,20cyclictest1443303-21cat11:31:200
1178854993819,17cyclictest1289915-21sendmail09:00:000
117885499380,25cyclictest1354575-21taskset10:04:230
1178859993733,3cyclictest1344534-21kworker/u8:2+events_unbound10:41:201
1178859993731,5cyclictest238201-21kworker/u8:2+events_unbound07:41:031
1178859993731,4cyclictest1434276-21kworker/u8:3+events_unbound11:26:211
1178859993731,4cyclictest1245380-21kworker/u8:1+flush-8:008:16:101
117885499373,17cyclictest0-21swapper/008:44:200
1178854993727,7cyclictest280-21systemd-journal09:31:200
117885499372,23cyclictest0-21swapper/012:26:470
117885499372,19cyclictest1479814-21/usr/sbin/munin12:11:100
117885499371,21cyclictest589-21runrttasks07:11:090
11785132373,9sleep10-21swapper/107:08:121
1178861993629,5cyclictest1250970-21cut08:21:062
1178861993626,8cyclictest1349483-21/usr/sbin/munin09:59:592
117885499363,28cyclictest0-21swapper/009:06:020
117885499363,27cyclictest0-21swapper/010:36:040
117885499363,18cyclictest0-21swapper/011:11:470
117885499363,17cyclictest0-21swapper/011:50:430
1178854993627,6cyclictest1404354-21latency_hist10:55:010
117885499362,25cyclictest0-21swapper/011:22:570
117885499362,24cyclictest0-21swapper/010:10:510
117885499362,24cyclictest0-21swapper/010:10:510
117885499362,20cyclictest0-21swapper/009:19:270
117885499362,19cyclictest0-21swapper/010:28:010
117885499362,19cyclictest0-21swapper/007:50:460
1178854993620,14cyclictest1438670-21unixbench_singl11:26:210
117885499361,21cyclictest1265561-21cut08:36:030
1178861993530,4cyclictest1194995-21kworker/u8:0+flush-8:007:38:272
1178859993530,4cyclictest238201-21kworker/u8:2+events_unbound07:46:091
117885499353,27cyclictest0-21swapper/008:01:030
117885499352,23cyclictest0-21swapper/007:32:200
117885499352,20cyclictest0-21swapper/008:30:350
117885499352,20cyclictest0-21swapper/008:30:350
117885499352,20cyclictest0-21swapper/008:17:260
117885499352,19cyclictest0-21swapper/009:56:270
117885499352,19cyclictest0-21swapper/007:55:240
117885499352,18cyclictest0-21swapper/012:23:530
117885499352,18cyclictest0-21swapper/010:43:580
117885499352,18cyclictest0-21swapper/008:47:370
117885499352,17cyclictest0-21swapper/009:52:120
117885499351,5cyclictest1214857-21runrttasks07:41:190
117885499351,18cyclictest1451402-21/usr/sbin/munin11:41:120
117885499342,18cyclictest0-21swapper/012:05:190
1178859993329,3cyclictest1414513-21kworker/u8:1+flush-8:011:21:121
1178859993329,3cyclictest1354898-21kworker/u8:3+flush-8:010:16:571
1178859993329,3cyclictest1194995-21kworker/u8:0+events_unbound07:35:161
1178854993327,4cyclictest1464051-21apt-get11:56:020
117838823324,3sleep00-21swapper/007:06:340
1178861993221,9cyclictest1309952-21awk09:20:002
1178859993225,6cyclictest1245380-21kworker/u8:1+flush-8:008:36:221
1178859993225,5cyclictest1295431-21apt-get09:06:021
1178861993121,8cyclictest1230274-21apt-get08:00:002
1178861993024,4cyclictest1304584-21unixbench_multi09:11:222
1178859993025,4cyclictest1194995-21kworker/u8:0+events_unbound10:11:061
1178859993025,4cyclictest1194995-21kworker/u8:0+events_unbound10:11:051
1178861992825,2cyclictest1329334-21unixbench_multi09:36:222
1178861992820,6cyclictest1220689-21apt-get07:51:022
1178861992723,2cyclictest1444353-21aten2_r5power_e11:36:032
1178861992723,2cyclictest1343567-21tail09:51:142
117886199270,25cyclictest1-21systemd10:40:012
1178861992623,2cyclictest1469114-21aten2_r5power_p12:01:042
1178861992621,3cyclictest1320235-21aten2_r5power_e09:31:052
1178861992620,4cyclictest1339197-21unixbench_multi09:46:222
1178861992618,6cyclictest1503568-21turbostat.cron12:35:002
1178861992618,6cyclictest1205487-21idleruntime-cro07:35:002
1178861992521,2cyclictest1350166-21aten2_r5power_v10:01:062
1178861992521,2cyclictest1279623-21unixbench_multi08:46:222
1178859992521,3cyclictest1294564-21kworker/u8:1+events_unbound09:45:521
1178861992421,2cyclictest1236162-21fschecks_time08:06:052
1178861992420,2cyclictest1424732-21cpuspeed_turbos11:16:042
1178861992420,2cyclictest1389936-21aten2_r5power_p10:41:032
1178861992417,5cyclictest1433158-21ntpq11:21:152
1178861992319,2cyclictest1375200-21cpuspeed_turbos10:26:042
117886199231,10cyclictest12915932kthreadcore09:01:112
117886199228,9cyclictest1434373-21apt-get11:26:012
1178861992219,2cyclictest1245994-21fschecks_time08:16:062
1178861992218,2cyclictest0-21swapper/209:09:592
1178861992217,4cyclictest1359592-21awk10:10:002
11786142229,9sleep20-21swapper/207:09:292
1178861992118,2cyclictest1453511-21unixbench_singl11:41:232
1178861992118,2cyclictest1179336-21fschecks_count07:11:142
1178861992117,2cyclictest0-21swapper/212:16:132
1178861992116,3cyclictest1483117-21unixbench_multi12:11:212
117886199202,13cyclictest1210819-21apt-get07:41:012
1178861992016,3cyclictest0-21swapper/210:59:592
1178861992016,2cyclictest0-21swapper/207:26:012
1178861992015,3cyclictest1384163-21unixbench_multi10:31:212
1178861992012,6cyclictest1498820-21cut12:30:012
14668422190,6chrt0-21swapper/211:56:122
13682022190,2chrt75-21kworker/3:1+events10:16:133
117886199194,2cyclictest13689972cat10:16:222
1178861991915,3cyclictest0-21swapper/208:41:212
1178861991915,2cyclictest0-21swapper/208:31:202
1178861991915,2cyclictest0-21swapper/208:31:202
1178861991914,4cyclictest1418886-21unixbench_singl11:06:212
1178861991913,4cyclictest1289922-21sendmail09:00:002
1178861991910,7cyclictest1361902-21tr10:11:122
1178861991910,7cyclictest1361902-21tr10:11:122
11785482193,9sleep30-21swapper/307:08:383
13967632180,2sleep3481ktimers/310:46:113
117886199189,7cyclictest1411746-21tr11:01:112
1178861991814,2cyclictest1394872-21aten2_r5power_p10:46:042
1178861991814,2cyclictest1319456-21unixbench_multi09:26:222
1178861991814,2cyclictest1215809-21aten2_r5power_c07:46:052
1178861991814,2cyclictest0-21swapper/209:21:222
1178861991814,2cyclictest0-21swapper/208:51:032
1178861991813,4cyclictest0-21swapper/208:15:002
117886199181,12cyclictest1488811-21apt-get12:21:032
117886199181,12cyclictest1190946-21taskset07:21:042
1178861991712,3cyclictest0-21swapper/211:51:222
117886199171,12cyclictest1230274-21apt-get08:00:032
117886199166,8cyclictest1330413-21sort09:41:062
1178861991613,2cyclictest0-21swapper/211:11:222
1178861991612,2cyclictest0-21swapper/210:20:542
117886199161,11cyclictest1259334-21ntpq08:26:142
1178861991610,4cyclictest1344534-21kworker/u8:2+flush-8:011:31:062
117886199157,6cyclictest1454796-21sed11:46:092
117886199157,6cyclictest1454796-21sed11:46:092
117886199156,7cyclictest1400404-21sed10:51:092
12655042142,8sleep30-21swapper/308:36:013
12206922142,8sleep30-21swapper/307:51:023
14826102132,7sleep30-21swapper/312:11:153
14676652132,7sleep30-21swapper/311:56:143
13862542133,7sleep30-21swapper/310:36:123
13346332130,8sleep30-21swapper/309:45:003
12643512133,6sleep30-21swapper/308:31:163
12643512133,6sleep30-21swapper/308:31:163
14992352122,6sleep30-21swapper/312:31:083
14940212122,6sleep30-21swapper/312:26:083
14842672122,6sleep30-21swapper/312:16:083
14775862123,5sleep30-21swapper/312:06:133
14733322122,6sleep30-21swapper/312:01:243
14614542122,6sleep30-21swapper/311:51:123
14587692122,6sleep30-21swapper/311:49:563
14587692122,6sleep30-21swapper/311:49:553
14398802122,6sleep30-21swapper/311:31:093
14300542122,5sleep30-21swapper/311:21:113
14199182122,6sleep30-21swapper/311:11:083
14142902122,5sleep30-21swapper/311:05:023
14135762122,6sleep30-21swapper/311:01:203
13941012122,6sleep30-21swapper/310:41:213
13797792122,5sleep30-21swapper/310:30:023
13785902122,6sleep30-21swapper/310:26:123
13602302122,6sleep30-21swapper/310:11:083
13602302122,6sleep30-21swapper/310:11:073
13491222122,6sleep30-21swapper/309:56:243
13398812122,6sleep30-21swapper/309:51:023
13201792124,5sleep30-21swapper/309:31:043
13152142122,6sleep30-21swapper/309:26:013
13107262120,8sleep30-21swapper/309:21:083
12907362122,6sleep30-21swapper/309:01:103
12801732122,5sleep30-21swapper/308:50:023
12704252122,6sleep30-21swapper/308:40:553
12559862122,6sleep30-21swapper/308:26:063
12470532122,6sleep30-21swapper/308:16:123
12404712122,5sleep30-21swapper/308:10:023
12358162122,6sleep30-21swapper/308:06:043
12262042122,6sleep30-21swapper/307:56:093
12154772122,5sleep30-21swapper/307:45:023
11837002122,7sleep30-21swapper/307:14:563
15037942111,5sleep30-21swapper/312:35:023
14885052112,5sleep30-21swapper/312:20:023
14488962112,5sleep30-21swapper/311:40:013
14447472112,5sleep30-21swapper/311:36:083
14384032112,5sleep30-21swapper/311:26:203
14244782112,5sleep30-21swapper/311:16:013
14045772112,5sleep30-21swapper/310:55:023
14002442112,5sleep30-21swapper/310:51:093
13740412112,6sleep30-21swapper/310:21:243
13552092112,5sleep30-21swapper/310:06:073
13504092112,5sleep30-21swapper/310:01:093
13349792112,5sleep30-21swapper/309:46:043
13255232112,5sleep30-21swapper/309:36:093
13052012112,5sleep30-21swapper/309:15:023
13005262112,5sleep30-21swapper/309:11:053
12992782112,5sleep30-21swapper/309:06:203
12852052112,6sleep30-21swapper/308:55:203
12787842112,5sleep30-21swapper/308:46:133
12511812112,5sleep30-21swapper/308:21:093
12307812112,5sleep30-21swapper/308:00:263
12107502112,6sleep30-21swapper/307:40:283
12057622112,6sleep30-21swapper/307:35:423
12050532112,5sleep30-21swapper/307:31:253
11959242112,5sleep30-21swapper/307:26:033
11843112112,6sleep30-21swapper/307:15:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional