You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-30 - 12:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Mon Mar 30, 2026 00:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1176018995544,8cyclictest1426595-21cp23:20:012
1176009995347,4cyclictest1202745-21latency_hist19:35:010
1176014994939,7cyclictest1346875-21latency_hist22:00:011
1176018994336,5cyclictest1346873-21apt-get22:00:002
1176009994333,7cyclictest1421564-21latency_hist23:15:010
1176014994234,6cyclictest1435764-21ntpq23:26:371
1176018994134,5cyclictest280-21systemd-journal20:47:352
1176014993935,3cyclictest1202565-21kworker/u8:2+events_unbound21:36:331
1176014993933,4cyclictest1377332-21kworker/u8:1+events_unbound00:05:011
1176009993831,4cyclictest1461397-21latency_hist23:55:010
1176009993829,7cyclictest1222831-21/usr/sbin/munin19:56:350
13854372370,5sleep30-21swapper/322:36:353
1176009993728,7cyclictest1372106-21latency_hist22:25:010
117600999371,35cyclictest1242324-21kworker/0:0+events21:09:100
1176014993627,7cyclictest280-21systemd-journal21:50:001
1176014993624,8cyclictest280-21systemd-journal23:40:491
117561323625,6sleep1291ktimers/119:06:491
1176014993527,5cyclictest280-21systemd-journal23:45:491
1176014993527,5cyclictest1277176-21latency_hist20:50:011
117600999351,30cyclictest1481207-21kworker/0:2+events00:25:440
117600999350,30cyclictest1156379-21kworker/0:2+events20:01:180
1176009993427,5cyclictest336430-21kworker/u8:4+flush-8:020:31:330
1176009993426,6cyclictest1262452-21/usr/sbin/munin20:36:370
117600999342,27cyclictest1292303-21kworker/0:2+events22:10:240
1176014993326,5cyclictest1143851-21kworker/u8:2+flush-8:019:11:291
1176009993329,2cyclictest1197808-21systemd-run19:30:000
117600999331,31cyclictest1367042-21kworker/0:0+events22:53:380
117600999331,26cyclictest1292303-21kworker/0:2+events22:01:250
14108002320,2sleep2381ktimers/223:01:342
12380202320,6sleep30-21swapper/320:11:283
1176014993225,5cyclictest1202565-21kworker/u8:2+flush-8:019:56:411
1176014993223,6cyclictest1500961-21latency_hist00:35:011
1176009993224,6cyclictest1482128-21irqcore00:16:320
1176009993224,6cyclictest1180576-21unixbench_multi19:11:440
117600999321,30cyclictest1367042-21kworker/0:0+events23:24:160
117600999321,30cyclictest1367042-21kworker/0:0+events22:47:250
117600999321,30cyclictest1367042-21kworker/0:0+events22:47:250
117600999321,30cyclictest1232415-21kworker/0:1+events20:13:380
117600999321,26cyclictest1367042-21kworker/0:0+events23:40:340
117600999321,26cyclictest1292303-21kworker/0:2+events21:30:380
117600999320,27cyclictest1156379-21kworker/0:2+events19:46:050
1176018993125,5cyclictest1377332-21kworker/u8:1+flush-8:000:26:382
1176014993125,4cyclictest1212274-21grep19:41:441
1176014993125,4cyclictest0-21swapper/100:20:001
1176014993123,6cyclictest280-21systemd-journal23:55:001
1176014993121,8cyclictest1221651-21ntpq19:51:381
117600999318,18cyclictest1242324-21kworker/0:0+events20:50:220
117600999317,19cyclictest1367042-21kworker/0:0+events00:00:400
117600999317,19cyclictest1292303-21kworker/0:2+events21:25:140
117600999312,28cyclictest1242324-21kworker/0:0+events20:46:290
117600999310,30cyclictest1292303-21kworker/0:2+events22:09:120
1176014993022,6cyclictest1192039-21ntpq19:21:391
117600999307,19cyclictest1367042-21kworker/0:0+events23:05:100
117600999306,19cyclictest1156379-21kworker/0:2+events19:40:050
117600999303,26cyclictest1367042-21kworker/0:0+events22:35:060
117600999303,26cyclictest1156379-21kworker/0:2+events19:15:040
117600999302,27cyclictest1292303-21kworker/0:2+events21:24:220
1176009993022,6cyclictest1346546-21unixbench_multi21:56:450
117600999301,28cyclictest1367042-21kworker/0:0+events23:03:140
117600999301,28cyclictest1292303-21kworker/0:2+events21:44:240
1176018992922,5cyclictest1287368-21store21:00:012
1176014992924,3cyclictest1227811-21apt-get20:01:221
1176014992923,4cyclictest1281843-21unixbench_singl20:51:441
1176014992920,7cyclictest1201945-21ntpq19:31:401
1176014992920,6cyclictest1505543-21grep00:36:441
1176014992919,8cyclictest1291408-21ntpq21:01:361
117600999299,16cyclictest1242324-21kworker/0:0+events20:25:380
117600999298,19cyclictest1156379-21kworker/0:2+events19:24:380
117600999295,19cyclictest1242324-21kworker/0:0+events20:55:200
117600999295,19cyclictest1242324-21kworker/0:0+events20:20:080
1176009992924,3cyclictest0-21swapper/000:00:000
117600999292,26cyclictest1481207-21kworker/0:2+events00:23:020
117600999292,26cyclictest1367042-21kworker/0:0+events23:40:000
117600999292,26cyclictest1242324-21kworker/0:0+events21:02:100
117600999292,22cyclictest1232415-21kworker/0:1+events20:15:570
117600999291,27cyclictest1367042-21kworker/0:0+events23:31:490
1176009992910,17cyclictest1292303-21kworker/0:2+events21:52:060
1176014992822,4cyclictest1401459-21unixbench_multi22:51:451
1176014992822,4cyclictest1267663-21apt-get20:41:241
1176014992821,5cyclictest1461745-21apt-get23:56:241
117600999289,18cyclictest1367042-21kworker/0:0+events22:59:280
117600999287,20cyclictest1496024-21kworker/0:1+events00:36:130
117600999287,20cyclictest1292303-21kworker/0:2+events21:35:090
117600999284,19cyclictest1367042-21kworker/0:0+events00:05:090
117600999284,19cyclictest1156379-21kworker/0:2+events20:05:410
117600999282,25cyclictest1367042-21kworker/0:0+events22:31:580
1176009992822,4cyclictest1366934-21apt-key22:20:000
117600999282,24cyclictest1242324-21kworker/0:0+events20:41:420
1176009992819,7cyclictest280-21systemd-journal22:27:500
117600999281,26cyclictest1367042-21kworker/0:0+events23:29:300
117600999281,26cyclictest1292303-21kworker/0:2+events21:16:160
117600999281,26cyclictest1156379-21kworker/0:2+events19:39:460
117600999280,27cyclictest1367042-21kworker/0:0+events22:44:080
11712472282,6sleep00-21swapper/019:05:200
1176018992723,2cyclictest1387414-21aten2_r5power_e22:41:262
1176018992722,4cyclictest1202565-21kworker/u8:2+flush-8:019:51:422
1176018992722,3cyclictest1302782-21fschecks_count21:16:282
1176014992722,3cyclictest1213282-21fschecks_count19:46:301
1176014992720,5cyclictest1297530-21/usr/sbin/munin21:11:431
1176014992717,8cyclictest1386180-21ntpq22:36:391
117600999278,18cyclictest1292303-21kworker/0:2+events21:45:440
117600999270,25cyclictest1496024-21kworker/0:1+events00:30:420
1176018992622,2cyclictest1307787-21fschecks_count21:21:302
1176018992621,3cyclictest280-21systemd-journal22:05:002
117601899260,10cyclictest14986552cut00:31:332
1176014992623,2cyclictest1317025-21systemd-run21:30:001
1176014992622,2cyclictest1362902-21irqcore22:16:311
1176014992622,2cyclictest1307144-21sendmail21:20:001
1176014992621,4cyclictest1301876-21kworker/u8:3-ext4-rsv-conversion22:15:001
1176014992621,3cyclictest1486869-21cut00:21:301
1176014992621,3cyclictest1392525-21cpuspeed_turbos22:46:271
1176014992621,3cyclictest1392525-21cpuspeed_turbos22:46:271
1176014992620,4cyclictest1207369-21unixbench_singl19:36:421
1176014992618,6cyclictest1410831-21ntpq23:01:351
1176014992618,5cyclictest1-21systemd23:15:011
1176014992617,7cyclictest1356998-21latency_hist22:10:011
117600999267,18cyclictest1156379-21kworker/0:2+events19:52:290
117600999265,20cyclictest1292303-21kworker/0:2+events21:12:080
117600999265,16cyclictest1367042-21kworker/0:0+events23:15:020
1176009992622,2cyclictest1480291-21needreboot00:11:370
117600999261,24cyclictest1367042-21kworker/0:0+events23:49:100
13406222250,5sleep20-21swapper/221:51:352
12077482250,5sleep20-21swapper/219:40:012
1176018992521,2cyclictest1267978-21fschecks_time20:41:282
1176014992521,2cyclictest1422265-21cut23:16:271
1176014992521,2cyclictest1292882-21cut21:06:301
1176014992521,2cyclictest1193792-21irqcore19:26:311
1176014992520,3cyclictest20977-21cron20:30:001
1176014992520,2cyclictest0-21swapper/120:11:271
1176014992519,4cyclictest1436980-21apt-get23:31:241
1176014992518,5cyclictest1301876-21kworker/u8:3+events_unbound22:45:001
1176014992516,7cyclictest1405911-21ntpq22:56:361
1176014992511,10cyclictest1321935-21apt-get21:35:001
1176018992421,2cyclictest1451117-21unixbench_multi23:41:442
1176018992420,3cyclictest1377332-21kworker/u8:1+events_unbound23:51:442
1176018992420,3cyclictest1202565-21kworker/u8:2+flush-8:020:10:002
1176018992420,2cyclictest1192484-21unixbench_multi19:21:452
117601499243,6cyclictest0-21swapper/121:51:411
1176014992420,3cyclictest1377332-21kworker/u8:1+flush-8:000:25:031
1176014992419,3cyclictest1412635-21irqcore23:06:291
1176014992419,2cyclictest0-21swapper/120:56:281
1176014992419,2cyclictest0-21swapper/119:16:281
1176014992417,5cyclictest1444089-21cut23:36:331
1176014992416,6cyclictest280-21systemd-journal00:10:591
1176014992411,10cyclictest280-21systemd-journal20:25:011
1176018992319,3cyclictest1396552-21unixbench_singl22:46:442
1176018992319,3cyclictest1396552-21unixbench_singl22:46:442
1176018992319,3cyclictest0-21swapper/220:20:002
1176018992319,2cyclictest1472006-21fschecks_time00:06:272
1176018992318,4cyclictest1251892-21unixbench_multi20:21:452
1176018992317,4cyclictest1351818-21kworker/u8:1+events_unbound22:21:452
1176018992316,5cyclictest1431333-21unixbench_multi23:21:452
1176014992319,2cyclictest0-21swapper/122:26:441
1176014992319,2cyclictest0-21swapper/120:40:001
1176014992318,2cyclictest0-21swapper/120:16:421
1176014992317,4cyclictest1476267-21sh00:10:001
1176014992315,6cyclictest280-21systemd-journal22:05:001
1176018992219,2cyclictest1262695-21cpuspeed_turbos20:36:282
1176018992218,2cyclictest1397284-21aten2_r5power_e22:51:272
1176018992218,2cyclictest1321630-21unixbench_singl21:31:482
1176018992217,3cyclictest0-21swapper/222:35:002
117601499229,10cyclictest280-21systemd-journal21:42:461
117601499228,5cyclictest0-21swapper/123:22:021
1176014992217,3cyclictest1309642-21kthreadcore21:21:361
1176014992216,4cyclictest1380943-21kthreadcore22:31:361
1176014992215,4cyclictest0-21swapper/120:06:421
1176014992214,5cyclictest0-21swapper/120:31:291
14699372210,3sleep375-21kworker/3:1+events00:01:343
1176018992118,2cyclictest1302127-21cron21:15:002
1176018992117,2cyclictest1252689-21aten2_r5power_p20:26:262
1176018992116,3cyclictest1365969-21needreboot22:16:362
1176018992115,4cyclictest280-21systemd-journal20:55:012
1176018992115,4cyclictest1227436-21sendmail20:00:002
1176018992114,5cyclictest1185739-21cut19:16:342
1176018992111,2cyclictest0-21swapper/222:26:362
117601899202,2cyclictest11938571sed19:26:312
117601899202,12cyclictest1312396-21apt-get21:26:252
1176018992017,2cyclictest1476941-21fschecks_time00:11:302
1176018992017,2cyclictest1232080-21unixbench_singl20:01:432
117601899200,8cyclictest14885341kthreadcore00:21:352
1176014992016,2cyclictest0-21swapper/122:21:281
11710532204,9sleep20-21swapper/219:05:022
117601899197,8cyclictest1357352-21apt-get22:11:252
1176018991916,2cyclictest1452096-21fschecks_count23:46:282
1176018991915,3cyclictest20977-21cron22:10:002
1176018991915,2cyclictest0-21swapper/223:00:012
1176018991914,4cyclictest1327125-21idleruntime-cro21:40:002
1176018991913,4cyclictest1177221-21kthreadcore19:11:322
1176018991813,3cyclictest1383303-21sed22:36:332
11756472182,9sleep30-21swapper/319:07:163
12672302170,3chrt75-21kworker/3:1+events20:40:013
1176018991714,2cyclictest1466375-21cron00:00:002
1176018991713,3cyclictest0-21swapper/221:46:442
1176018991713,2cyclictest0-21swapper/223:26:282
1176018991712,3cyclictest0-21swapper/221:06:362
1176018991712,3cyclictest0-21swapper/221:01:292
1176018991712,3cyclictest0-21swapper/220:31:322
1176018991712,3cyclictest0-21swapper/200:20:002
15058822167,5sleep30-21swapper/300:39:593
117601899169,5cyclictest1438294-21tr23:31:322
117601899169,5cyclictest1215810-21tr19:46:362
117601899165,4cyclictest0-21swapper/223:05:162
117601899162,13cyclictest0-21swapper/219:41:212
117601899162,13cyclictest0-21swapper/200:03:382
117601899162,10cyclictest1505041-21ntpq00:36:372
1176018991613,2cyclictest0-21swapper/221:41:252
1176018991613,2cyclictest0-21swapper/219:31:422
1176018991611,3cyclictest0-21swapper/223:11:322
117601899161,11cyclictest1445785-21ntpq23:36:392
14407502155,6sleep30-21swapper/323:31:383
11999612156,5sleep30-21swapper/319:31:363
117601899152,2cyclictest0-21swapper/220:10:482
14778532132,7sleep30-21swapper/300:11:353
14614162132,6sleep30-21swapper/323:55:013
14175072133,6sleep30-21swapper/323:11:313
14007792132,7sleep30-21swapper/322:51:373
13877002132,7sleep30-21swapper/322:41:293
13468612132,7sleep30-21swapper/322:00:003
13078432132,7sleep30-21swapper/321:21:313
12771662132,6sleep30-21swapper/320:50:013
11928922132,6sleep30-21swapper/319:25:023
11918462132,7sleep30-21swapper/319:21:373
14871392122,6sleep30-21swapper/300:21:343
14814252122,6sleep30-21swapper/300:15:163
14570492122,6sleep30-21swapper/323:51:283
14322802122,6sleep30-21swapper/323:26:283
14263712122,6sleep30-21swapper/323:18:503
14125252122,6sleep30-21swapper/323:06:303
14114222122,6sleep30-21swapper/323:01:443
14057462122,6sleep30-21swapper/322:56:343
13968562122,6sleep30-21swapper/322:50:003
13968562122,6sleep30-21swapper/322:50:003
13773482122,6sleep30-21swapper/322:30:503
13626262122,6sleep30-21swapper/322:16:293
13573262122,6sleep30-21swapper/322:11:243
13522012122,6sleep30-21swapper/322:05:023
13473892122,6sleep30-21swapper/322:00:323
13375992122,6sleep30-21swapper/321:51:293
13271732122,6sleep30-21swapper/321:40:023
13223962122,6sleep30-21swapper/321:35:043
13173662122,6sleep30-21swapper/321:31:313
13024952123,6sleep30-21swapper/321:16:263
12980302122,6sleep30-21swapper/321:11:323
12924362122,5sleep30-21swapper/321:05:023
12672302122,5sleep30-21swapper/320:40:023
12540172122,6sleep30-21swapper/320:26:343
12428982122,6sleep30-21swapper/320:16:303
12373132122,6sleep30-21swapper/320:10:003
12274802122,5sleep30-21swapper/320:00:013
12191882122,6sleep30-21swapper/319:51:343
11772052122,6sleep30-21swapper/319:11:333
14960082112,5sleep30-21swapper/300:30:013
14916982112,5sleep30-21swapper/300:26:283
14716952112,5sleep30-21swapper/300:06:253
14517002112,5sleep30-21swapper/323:45:023
14478132112,5sleep30-21swapper/323:41:333
14464202112,6sleep30-21swapper/323:38:363
14270902112,5sleep30-21swapper/323:21:263
13761812112,5sleep30-21swapper/322:26:373
13675032112,5sleep30-21swapper/322:21:273
13323872112,6sleep30-21swapper/321:46:243
13161352112,5sleep30-21swapper/321:26:373
12879992112,5sleep30-21swapper/321:01:293
12829752112,5sleep30-21swapper/320:56:313
12774562112,5sleep30-21swapper/320:50:453
12616202112,5sleep30-21swapper/320:31:433
12516342112,5sleep30-21swapper/320:21:443
12228302112,5sleep30-21swapper/319:56:243
12129952112,5sleep30-21swapper/319:46:293
12080862112,6sleep30-21swapper/319:41:273
12027312112,5sleep30-21swapper/319:35:013
11812052110,6sleep30-21swapper/319:15:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional