You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-20 - 15:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Wed May 20, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
132439622150,3sleep375-21kworker/3:1+events10:40:003
132439622150,3sleep375-21kworker/3:1+events10:40:003
13931972910,5chrt0-21swapper/211:46:032
14366502760,3chrt0-21swapper/112:30:571
1113644996042,15cyclictest1413632-21latency_hist12:10:000
12588462580,1sleep10-21swapper/109:30:561
11499022580,2chrt1149905-21unixbench_singl07:41:041
1113644995748,6cyclictest1230161-21latency_hist09:05:010
1113646995549,4cyclictest1070626-21kworker/u8:1+events_unbound07:15:051
1113644995337,14cyclictest1240332-21/usr/sbin/munin09:15:570
1113644995337,14cyclictest1240332-21/usr/sbin/munin09:15:560
1113646995243,7cyclictest1704890-21systemd-journal09:15:001
1113646995242,7cyclictest1259874-21kworker/u8:3+flush-8:011:55:591
1113646995242,7cyclictest1259874-21kworker/u8:3+flush-8:011:55:591
1113651995040,8cyclictest1195345-21cp08:30:002
1113646995042,6cyclictest1125624-21kworker/u8:0+flush-8:008:40:581
11928332490,3chrt201rcuc/008:25:550
1113646994940,7cyclictest1384009-21latency_hist11:40:011
1113644994937,9cyclictest1704890-21systemd-journal07:55:000
1113644994924,22cyclictest1343366-21ntpq10:56:010
1113646994843,4cyclictest1240734-21kworker/u8:2+events_unbound10:26:011
1113646994842,4cyclictest1076159-21kworker/u8:3+events_unbound07:25:011
1113646994838,7cyclictest1384306-21/usr/sbin/munin11:41:031
1113646994742,4cyclictest1200460-21kworker/u8:1+events_unbound09:26:031
1113646994740,5cyclictest1259874-21kworker/u8:3+flush-8:012:01:041
1113646994740,5cyclictest1259874-21kworker/u8:3+events_unbound10:51:021
1113644994626,17cyclictest1225200-21latency_hist09:00:010
1113646994540,3cyclictest1070626-21kworker/u8:1+flush-8:007:46:061
1113646994540,3cyclictest1070626-21kworker/u8:1+flush-8:007:46:061
1113646994538,5cyclictest1314479-21kworker/u8:4+flush-8:011:01:041
1113646994538,5cyclictest1125624-21kworker/u8:0+flush-8:007:31:051
1113646994537,6cyclictest1409024-21apt-get12:05:461
1113646994536,7cyclictest1299704-21apt-get10:15:451
1113646994536,7cyclictest1200460-21kworker/u8:1+flush-8:010:01:011
1113644994535,8cyclictest1318304-21ntpq10:30:580
11631122440,2sleep3481ktimers/307:55:553
1113646994437,5cyclictest1125624-21kworker/u8:0+events_unbound08:51:021
1113646994339,3cyclictest1344454-21kworker/u8:0+events_unbound11:06:051
1113646994334,7cyclictest1283723-21ntpq09:56:001
1113646994334,7cyclictest1185659-21/usr/sbin/munin08:21:041
1113646994235,6cyclictest1259874-21kworker/u8:3+events_unbound10:30:581
1113646994232,8cyclictest1389287-21apt-get11:45:451
1113644994235,5cyclictest1344454-21kworker/u8:0+events_unbound11:36:060
1113646994136,4cyclictest1076159-21kworker/u8:3+events_unbound07:25:481
1113646994136,3cyclictest1125624-21kworker/u8:0+events_unbound08:35:011
1113646994134,5cyclictest1354418-21/usr/sbin/munin11:11:031
1113646994134,5cyclictest1245341-21apt-get09:20:441
1113646994134,5cyclictest1200460-21kworker/u8:1+events_unbound09:01:011
1113646994035,4cyclictest1165558-21kworker/u8:4+flush-8:008:05:531
1113646994034,5cyclictest1200460-21kworker/u8:1+flush-8:010:06:041
1113646994032,6cyclictest1200460-21kworker/u8:1+flush-8:009:35:591
1113646994030,8cyclictest1378226-21ntpq11:31:001
1113651993930,7cyclictest1190334-21awk08:25:002
1113646993934,4cyclictest1259874-21kworker/u8:3+flush-8:011:20:551
1113646993934,4cyclictest1229846-21kworker/u8:3+events_unbound09:06:041
1113646993933,4cyclictest1125624-21kworker/u8:0+flush-8:008:25:501
1113646993932,5cyclictest1344454-21kworker/u8:0+flush-8:012:16:001
1113646993929,7cyclictest1704890-21systemd-journal10:36:451
1113646993929,7cyclictest1704890-21systemd-journal10:36:441
1113644993922,15cyclictest1264854-21sh09:40:010
1113646993832,4cyclictest1200748-21apt-get08:35:461
1113646993832,4cyclictest1174929-21kworker/u8:1+events_unbound08:16:031
1113646993733,3cyclictest1314479-21kworker/u8:4+events_unbound11:00:011
1113646993732,4cyclictest1364258-21kworker/u8:1+events_unbound12:35:481
1113646993732,4cyclictest1259874-21kworker/u8:3+flush-8:009:41:011
1113644993720,15cyclictest1144835-21unixbench_multi07:36:050
1113644993719,16cyclictest1174281-21needreboot08:05:580
111364499371,13cyclictest589-21runrttasks11:55:460
111364499371,13cyclictest589-21runrttasks11:55:450
1113646993631,4cyclictest1220129-21kworker/u8:2+flush-8:008:56:001
1113646993631,3cyclictest1363208-21ntpq11:16:021
1113646993630,5cyclictest1240734-21kworker/u8:2+flush-8:010:41:001
1113646993630,4cyclictest1125624-21kworker/u8:0+flush-8:008:45:501
1113644993627,6cyclictest1215259-21latency_hist08:50:010
1113644993619,15cyclictest401-21dbus-daemon09:09:590
1113646993531,3cyclictest1125624-21kworker/u8:0+flush-8:007:50:541
1113646993530,3cyclictest1240734-21kworker/u8:2+events_unbound10:20:491
1113646993528,5cyclictest1270075-21apt-get09:45:461
1113644993526,6cyclictest1334562-21/usr/sbin/munin10:51:000
1113644993525,8cyclictest1438902-21diskstats12:35:490
1113644993518,15cyclictest0-21swapper/012:01:030
111364499351,14cyclictest1160677-21/usr/sbin/munin07:55:500
12786322340,7sleep0201rcuc/009:50:560
1113646993429,4cyclictest1200460-21kworker/u8:1+flush-8:010:10:581
1113646993428,5cyclictest1329040-21kworker/u8:0+flush-8:010:46:001
1113644993427,5cyclictest1200460-21kworker/u8:1+flush-8:009:25:540
1113644993419,13cyclictest1285428-21sort10:00:520
1113644993415,17cyclictest1385059-21tr11:40:520
1113644993414,18cyclictest1378714-21unixbench_singl11:31:060
1113644993414,18cyclictest1175508-21/usr/sbin/munin08:11:040
1113644993414,18cyclictest0-21swapper/008:35:540
1113644993413,19cyclictest0-21swapper/012:32:450
1113644993412,20cyclictest0-21swapper/011:23:450
11134162344,9sleep10-21swapper/107:09:231
1113651993329,3cyclictest1185424-21apt-config08:20:012
1113646993329,3cyclictest1259874-21kworker/u8:3+events_unbound09:50:551
1113646993328,4cyclictest1076159-21kworker/u8:3+flush-8:007:10:501
1113646993328,4cyclictest1070626-21kworker/u8:1+flush-8:007:36:001
1113646993327,5cyclictest1364258-21kworker/u8:1+flush-8:012:25:591
1113646993323,8cyclictest1169393-21ntpq08:00:591
111364499332,3cyclictest1273922-21ntpq09:46:020
1113644993312,3cyclictest0-21swapper/009:10:510
1113644993312,19cyclictest1395755-21kthreadcore11:50:530
1113644993312,19cyclictest1356773-21kthreadcore11:10:560
111364499331,15cyclictest1420501-21kthreadcore12:15:550
111364499331,12cyclictest589-21runrttasks12:25:460
1113651993223,7cyclictest1374128-21cp11:30:012
1113646993226,5cyclictest1070626-21kworker/u8:1+events_unbound07:55:501
1113644993227,3cyclictest1425993-21kthreadcore12:20:540
111364499322,12cyclictest583-21snmpd10:35:470
111364499322,12cyclictest583-21snmpd10:35:470
1113644993217,13cyclictest0-21swapper/008:51:020
1113644993213,17cyclictest20977-21cron07:15:000
111364499321,10cyclictest1393011-21ntpq11:45:590
111364499319,5cyclictest1314431-21sort10:30:010
111364499317,7cyclictest1-21systemd09:25:000
111364499317,6cyclictest1269500-21sshd09:41:440
111364499311,9cyclictest1129466-21ntpq07:21:000
1113644993115,14cyclictest0-21swapper/010:46:050
1113644993113,2cyclictest0-21swapper/008:40:530
1113644993113,16cyclictest0-21swapper/008:20:540
1113644993112,1cyclictest0-21swapper/007:15:040
1113644993112,16cyclictest0-21swapper/010:15:010
1113646993025,4cyclictest1364258-21kworker/u8:1+events_unbound12:11:071
1113646993024,5cyclictest1125624-21kworker/u8:0+flush-8:008:11:011
111364499301,9cyclictest1328724-21python310:41:040
1113644993014,14cyclictest0-21swapper/007:40:450
1113644993014,13cyclictest0-21swapper/010:20:010
1113644993012,6cyclictest1199626-21ntpq08:31:020
1113644993012,2cyclictest0-21swapper/012:10:540
111364499301,10cyclictest1372864-21memory11:25:580
111364499301,10cyclictest1139417-21ntpq07:31:010
1113644993010,6cyclictest1165857-21df08:00:500
1113644993010,3cyclictest8550irq/124-ahci[0000:00:12.0]11:10:000
1113651992923,4cyclictest1383589-21unixbench_multi11:36:052
1113651992911,2cyclictest13480172cut11:00:562
1113646992924,3cyclictest1373094-21ntpq11:26:011
111364499299,3cyclictest0-21swapper/007:25:530
111364499292,5cyclictest1348360-21ntpq11:01:000
1113644992912,15cyclictest0-21swapper/010:06:030
1113644992911,3cyclictest1181025-21sort08:15:550
1113644992911,2cyclictest0-21swapper/009:30:450
111364499291,10cyclictest589-21runrttasks11:15:470
111364499291,10cyclictest1113637-21cyclictest07:10:000
1113644992910,4cyclictest0-21swapper/010:20:570
1113651992824,2cyclictest1428097-21unixbench_multi12:21:052
111364499281,9cyclictest1154366-21ntpq07:46:010
111364499281,9cyclictest1154366-21ntpq07:46:010
1113644992811,2cyclictest0-21swapper/009:55:460
1113651992723,2cyclictest1200833-21aten2_r5power_p08:35:482
1113651992717,8cyclictest1704890-21systemd-journal10:55:012
1113646992724,2cyclictest1242531-21kthreadcore09:15:541
1113646992724,2cyclictest1242531-21kthreadcore09:15:541
1113646992723,3cyclictest1364258-21kworker/u8:1+events_unbound12:20:491
1113646992720,3cyclictest0-21swapper/111:50:451
1113651992622,3cyclictest1274343-21unixbench_singl09:46:062
1113651992616,7cyclictest1170293-21awk08:05:012
111365199258,3cyclictest12588472missed_timers09:30:562
1113651992520,3cyclictest0-21swapper/210:50:012
1113651992420,2cyclictest1437948-21unixbench_multi12:31:062
1113651992420,2cyclictest1413994-21aten2_r5power_e12:10:482
1113651992420,2cyclictest1324746-21aten2_r5power_c10:40:462
1113651992419,3cyclictest1240391-21aten2_r5power_c09:15:472
1113651992419,3cyclictest1240391-21aten2_r5power_c09:15:472
1113651992320,2cyclictest1384418-21aten2_r5power_p11:40:482
1113651992320,2cyclictest1210976-21fschecks_time08:45:512
1113651992319,3cyclictest1290148-21fschecks_time10:05:502
1113651992319,3cyclictest1240047-21idleruntime-cro09:14:592
1113651992319,2cyclictest1234704-21unixbench_multi09:06:082
111365199222,14cyclictest1399131-21apt-get11:55:462
111365199222,14cyclictest1399131-21apt-get11:55:452
1113651992219,2cyclictest1418947-21aten2_r5power_e12:15:482
1113651992219,2cyclictest1250334-21aten2_r5power_e09:25:472
1113651992219,2cyclictest1205731-21aten2_r5power_c08:40:442
1113651992218,3cyclictest1135841-21cpuspeed_turbos07:30:492
1113651992218,2cyclictest1409376-21fschecks_time12:05:512
1113651992217,3cyclictest1324022-21unixbench_singl10:36:052
1113651992217,3cyclictest1324022-21unixbench_singl10:36:052
1113651992216,5cyclictest1129979-21unixbench_singl07:21:072
1113651992216,4cyclictest1363611-21unixbench_multi11:16:062
1113651992216,4cyclictest1245655-21fschecks_time09:20:482
111365199213,2cyclictest13050742basename10:20:512
1113651992017,2cyclictest1428866-21aten2_r5power_p12:25:472
1113651992016,2cyclictest1408358-21unixbench_singl12:01:062
1113651992016,2cyclictest0-21swapper/209:40:572
1113651992014,5cyclictest0-21swapper/212:38:102
11132852204,9sleep20-21swapper/207:07:452
111365199196,11cyclictest1298446-21grep10:10:552
1113651991916,2cyclictest1140847-21fschecks_count07:35:512
1113651991913,4cyclictest0-21swapper/208:10:462
1113651991913,4cyclictest0-21swapper/208:00:012
1113651991910,7cyclictest1374790-21fschecks_time11:30:502
111365199188,7cyclictest1117583-21grep07:10:572
1113651991814,3cyclictest0-21swapper/210:00:552
1113651991814,2cyclictest0-21swapper/211:20:582
1113651991813,3cyclictest0-21swapper/207:40:522
11133612183,8sleep30-21swapper/307:08:423
11546152178,6sleep30-21swapper/307:46:063
11546152178,6sleep30-21swapper/307:46:053
111365199178,7cyclictest1228116-21tr09:00:562
111365199177,8cyclictest1283138-21tr09:55:552
1113651991714,2cyclictest0-21swapper/210:27:232
1113651991713,2cyclictest1349569-21aten2_r5power_e11:05:502
1113651991713,2cyclictest0-21swapper/211:10:512
1113651991713,2cyclictest0-21swapper/210:16:052
1113651991713,2cyclictest0-21swapper/208:55:572
1113651991713,2cyclictest0-21swapper/208:06:062
1113651991712,3cyclictest0-21swapper/210:30:562
1113651991712,3cyclictest0-21swapper/209:50:542
1113651991712,3cyclictest0-21swapper/207:55:012
111365199170,15cyclictest1396024-21tr11:50:532
111365199167,7cyclictest1150556-21cut07:45:482
111365199167,7cyclictest1150556-21cut07:45:482
111365199167,7cyclictest1118936-21tr07:15:022
111365199166,8cyclictest1264363-21grep09:36:062
1113651991613,2cyclictest1215832-21fschecks_count08:50:502
1113651991611,3cyclictest0-21swapper/208:30:572
111365199161,11cyclictest1339571-21apt-get10:55:462
111365199160,14cyclictest1133273-21kthreadcore07:25:552
11555072152,8sleep30-21swapper/307:50:483
14040402142,8sleep30-21swapper/312:00:453
13058202142,8sleep30-21swapper/310:20:553
12457812142,8sleep30-21swapper/309:20:523
14273722132,7sleep30-21swapper/312:20:573
13987912133,6sleep30-21swapper/311:54:443
13863582132,7sleep30-21swapper/311:40:563
13033072132,7sleep30-21swapper/310:15:563
12648582133,6sleep30-21swapper/309:40:013
12012432132,7sleep30-21swapper/308:35:543
11653332132,6sleep30-21swapper/308:00:023
11254442132,6sleep30-21swapper/307:20:023
11216342133,7sleep30-21swapper/307:15:573
14379302122,6sleep30-21swapper/312:31:073
14090272122,7sleep30-21swapper/312:05:483
13792922122,5sleep30-21swapper/311:35:023
13695432122,6sleep30-21swapper/311:25:513
13640422122,5sleep30-21swapper/311:20:013
13608642122,6sleep30-21swapper/311:15:553
13580592122,6sleep30-21swapper/311:10:593
13491872122,6sleep30-21swapper/311:05:013
13395432122,6sleep30-21swapper/310:55:463
13383862122,6sleep30-21swapper/310:51:003
13300242122,6sleep30-21swapper/310:45:513
13287612122,6sleep30-21swapper/310:41:043
13143892122,6sleep30-21swapper/310:30:013
13095902122,6sleep30-21swapper/310:25:483
12952442121,7sleep30-21swapper/310:10:523
12895752122,6sleep30-21swapper/310:05:023
12853712122,6sleep30-21swapper/310:00:513
12441122122,6sleep30-21swapper/309:15:583
12441122122,6sleep30-21swapper/309:15:583
12358002122,6sleep30-21swapper/309:10:533
12351002123,6sleep30-21swapper/309:10:003
12252442122,5sleep30-21swapper/309:00:013
12248832122,6sleep30-21swapper/308:56:083
12101732122,6sleep30-21swapper/308:42:523
12001162122,6sleep30-21swapper/308:31:083
11949212122,6sleep30-21swapper/308:26:073
11752152122,5sleep30-21swapper/308:10:013
11706162122,6sleep30-21swapper/308:05:483
11493882122,6sleep30-21swapper/307:41:003
11353002122,5sleep30-21swapper/307:30:013
14422462112,5sleep30-21swapper/312:35:573
14324932112,5sleep30-21swapper/312:25:583
14191492112,5sleep30-21swapper/312:15:503
14139062112,5sleep30-21swapper/312:10:453
13990932112,6sleep30-21swapper/311:55:373
13990932112,6sleep30-21swapper/311:55:373
13897952111,6sleep30-21swapper/311:45:543
13744452112,5sleep30-21swapper/311:30:483
13494782112,5sleep30-21swapper/311:05:453
12798612112,5sleep30-21swapper/309:55:033
12754932111,6sleep30-21swapper/309:50:533
12700782112,6sleep30-21swapper/309:45:483
12647482112,6sleep30-21swapper/309:39:223
12556252112,5sleep30-21swapper/309:30:513
12511932112,5sleep30-21swapper/309:25:523
12154832112,5sleep30-21swapper/308:50:023
12106652112,5sleep30-21swapper/308:45:493
11861252112,5sleep30-21swapper/308:20:533
11807482112,5sleep30-21swapper/308:15:513
11404742112,5sleep30-21swapper/307:35:033
11360752112,5sleep30-21swapper/307:30:533
11137662112,5sleep30-21swapper/307:10:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional