You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-04 - 10:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Sat Apr 04, 2026 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
23551223950,3sleep375-21kworker/3:1-events22:56:343
6149996051,4cyclictest216574-21kworker/u8:0+events_unbound00:26:390
6151995753,3cyclictest216574-21kworker/u8:0+events_unbound23:46:381
6149995450,3cyclictest87666-21kworker/u8:2+events_unbound20:36:390
6151995347,5cyclictest71994-21kworker/u8:0+flush-8:022:21:381
6151995347,4cyclictest226296-21kworker/u8:2+events_unbound23:06:391
6149995349,3cyclictest216574-21kworker/u8:0+events_unbound23:36:400
6151995147,3cyclictest246476-21kworker/u8:1+events_unbound00:15:001
6151995147,3cyclictest127477-21kworker/u8:3+flush-8:021:21:401
6151995144,6cyclictest216574-21kworker/u8:0+events_unbound00:26:251
6151995142,7cyclictest37698-21latency_hist19:40:011
6149995146,4cyclictest87666-21kworker/u8:2+events_unbound20:45:020
6149995143,3cyclictest4168534-21kworker/u8:4+events_unbound20:01:390
6149995143,3cyclictest4168534-21kworker/u8:4+events_unbound20:01:390
6151995041,7cyclictest271231-21latency_hist23:35:011
6149995046,3cyclictest71994-21kworker/u8:0+events_unbound21:56:390
6149995046,3cyclictest246476-21kworker/u8:1+events_unbound00:31:380
6149995046,3cyclictest246476-21kworker/u8:1+events_unbound00:31:380
6149995041,3cyclictest226296-21kworker/u8:2+events_unbound23:06:230
6151994944,4cyclictest246476-21kworker/u8:1+flush-8:000:06:261
6151994938,4cyclictest71994-21kworker/u8:0+events_unbound21:01:251
6149994945,3cyclictest3370580-21kworker/u8:1+events_unbound19:31:370
6149994945,3cyclictest226296-21kworker/u8:2+events_unbound23:41:390
6149994942,3cyclictest127477-21kworker/u8:3+events_unbound21:21:360
6149994939,4cyclictest246476-21kworker/u8:1+events_unbound00:06:230
6151994843,3cyclictest310579-21kworker/u8:2+events_unbound00:16:371
6151994842,5cyclictest201675-21kworker/u8:3+events_unbound22:46:241
6149994844,3cyclictest117579-21kworker/u8:1+events_unbound21:01:380
6149994743,3cyclictest87666-21kworker/u8:2+events_unbound20:31:250
6149994743,3cyclictest71994-21kworker/u8:0+events_unbound22:01:240
6149994743,3cyclictest4168534-21kworker/u8:4+events_unbound19:46:400
6149994743,3cyclictest3370580-21kworker/u8:1+events_unbound19:16:360
6149994740,3cyclictest3370580-21kworker/u8:1+events_unbound19:51:370
6149994740,3cyclictest127477-21kworker/u8:3+events_unbound21:16:270
6151994642,3cyclictest87666-21kworker/u8:2+flush-8:020:36:401
6151994642,3cyclictest3370580-21kworker/u8:1+flush-8:019:21:411
6151994638,6cyclictest226296-21kworker/u8:2+flush-8:023:01:361
6149994642,3cyclictest71994-21kworker/u8:0+events_unbound22:06:380
6149994642,3cyclictest3370580-21kworker/u8:1+events_unbound19:26:400
6149994642,3cyclictest13206-21kworker/u8:2+events_unbound19:41:370
6149994642,3cyclictest13206-21kworker/u8:2+events_unbound19:36:360
6149994639,3cyclictest246476-21kworker/u8:1+events_unbound00:21:380
6151994540,4cyclictest246476-21kworker/u8:1+flush-8:000:01:331
6151994539,5cyclictest226296-21kworker/u8:2+events_unbound23:16:351
6149994537,3cyclictest201675-21kworker/u8:3+events_unbound22:36:230
6151994338,3cyclictest216574-21kworker/u8:0+events_unbound23:21:261
6149994339,3cyclictest4168534-21kworker/u8:4+events_unbound19:56:280
6149994339,3cyclictest201675-21kworker/u8:3+events_unbound22:31:380
6149994332,9cyclictest6639-21diskstats19:11:250
6151994238,3cyclictest71994-21kworker/u8:0+flush-8:020:41:391
6151994238,3cyclictest157149-21kworker/u8:1+events_unbound22:16:401
6151994237,4cyclictest226296-21kworker/u8:2+events_unbound23:11:381
6149994238,3cyclictest71994-21kworker/u8:0+events_unbound21:26:330
6149994238,3cyclictest3370580-21kworker/u8:1+events_unbound20:16:400
6149994238,3cyclictest3370580-21kworker/u8:1+events_unbound20:16:400
6149994238,3cyclictest226296-21kworker/u8:2+events_unbound23:31:430
6149994238,3cyclictest216574-21kworker/u8:0+events_unbound22:56:280
6149994237,4cyclictest71994-21kworker/u8:0+events_unbound21:51:420
6149994234,3cyclictest226296-21kworker/u8:2+events_unbound23:11:420
6151994138,2cyclictest226296-21kworker/u8:2+flush-8:023:41:341
6151994136,4cyclictest157149-21kworker/u8:1+flush-8:022:01:341
6149994137,3cyclictest71994-21kworker/u8:0+events_unbound21:41:380
6149994137,3cyclictest246476-21kworker/u8:1+events_unbound00:01:420
6151994035,3cyclictest4168534-21kworker/u8:4+flush-8:019:46:391
6151994034,5cyclictest4168534-21kworker/u8:4+events_unbound20:11:431
6151994034,4cyclictest162232-21apt-get21:46:211
6149994036,3cyclictest127477-21kworker/u8:3+events_unbound21:36:410
6149994031,4cyclictest71994-21kworker/u8:0+events_unbound22:21:220
6151993935,3cyclictest4168534-21kworker/u8:4+events_unbound20:16:311
6151993935,3cyclictest4168534-21kworker/u8:4+events_unbound20:16:311
6151993935,3cyclictest216574-21kworker/u8:0+flush-8:022:56:401
6151993934,4cyclictest201675-21kworker/u8:3+flush-8:022:26:341
6151993934,3cyclictest87666-21kworker/u8:2+events_unbound20:31:381
6151993934,3cyclictest127477-21kworker/u8:3+flush-8:021:11:341
6149993935,3cyclictest71994-21kworker/u8:0+events_unbound20:56:430
6149993935,3cyclictest71994-21kworker/u8:0+events_unbound20:51:210
6149993935,3cyclictest226296-21kworker/u8:2+events_unbound23:16:220
6149993935,3cyclictest201675-21kworker/u8:3+events_unbound22:26:410
6151993833,4cyclictest71994-21kworker/u8:0+events_unbound22:11:371
6149993830,3cyclictest127477-21kworker/u8:3+events_unbound21:32:250
6149993826,4cyclictest87666-21kworker/u8:2+events_unbound21:07:280
6151993733,3cyclictest4168534-21kworker/u8:4+flush-8:020:21:401
6151993733,3cyclictest4168534-21kworker/u8:4+flush-8:020:21:401
6151993732,4cyclictest3370580-21kworker/u8:1+flush-8:019:26:401
6151993732,4cyclictest127477-21kworker/u8:3+events_unbound21:16:351
6149993733,3cyclictest71994-21kworker/u8:0+events_unbound22:11:270
6149993733,3cyclictest71994-21kworker/u8:0+events_unbound20:26:430
6149993733,3cyclictest157149-21kworker/u8:1+events_unbound22:16:270
6151993632,3cyclictest246476-21kworker/u8:1+flush-8:023:51:411
6151993631,4cyclictest4168534-21kworker/u8:4+flush-8:020:56:301
6151993631,4cyclictest3370580-21kworker/u8:1+flush-8:020:06:411
6151993631,4cyclictest3370580-21kworker/u8:1+flush-8:020:06:411
6149993632,3cyclictest201675-21kworker/u8:3+events_unbound22:51:230
6149993626,8cyclictest295133-21ntpq23:56:340
6149993626,3cyclictest226296-21kworker/u8:2+events_unbound23:46:480
6149993624,4cyclictest246476-21kworker/u8:1+events_unbound23:20:370
6155993526,7cyclictest4168534-21kworker/u8:4+flush-8:020:11:292
6151993531,3cyclictest4168534-21kworker/u8:4+events_unbound19:16:341
6151993530,4cyclictest71994-21kworker/u8:0+events_unbound21:26:371
6151993530,4cyclictest216574-21kworker/u8:0+flush-8:000:36:351
6151993527,3cyclictest71994-21kworker/u8:0+events_unbound21:51:571
6151993525,4cyclictest87666-21kworker/u8:2+events_unbound20:51:331
6149993531,3cyclictest4168534-21kworker/u8:4+events_unbound20:11:360
6149993530,4cyclictest246476-21kworker/u8:1+events_unbound00:18:380
6149993524,4cyclictest216574-21kworker/u8:0+events_unbound22:49:470
6151993430,3cyclictest3370580-21kworker/u8:1+events_unbound19:41:431
6151993430,3cyclictest246476-21kworker/u8:1+flush-8:023:56:261
6149993430,3cyclictest246476-21kworker/u8:1+events_unbound00:11:410
6149993430,3cyclictest226296-21kworker/u8:2+events_unbound23:01:290
6151993329,3cyclictest71994-21kworker/u8:0+flush-8:020:26:291
6151993329,3cyclictest4168534-21kworker/u8:4+events_unbound20:01:271
6151993329,3cyclictest4168534-21kworker/u8:4+events_unbound20:01:271
6151993329,3cyclictest3370580-21kworker/u8:1+flush-8:019:31:341
6151993329,3cyclictest211167-21kworker/u8:1+flush-8:022:41:351
6151993329,3cyclictest117579-21kworker/u8:1+flush-8:021:06:381
6151993327,4cyclictest216574-21kworker/u8:0+flush-8:023:36:291
6149993329,3cyclictest216574-21kworker/u8:0+events_unbound23:28:000
6149993329,3cyclictest216574-21kworker/u8:0+events_unbound00:36:390
6149993317,4cyclictest0-21swapper/020:41:210
6151993228,3cyclictest216574-21kworker/u8:0+flush-8:023:26:341
6151993228,3cyclictest201675-21kworker/u8:3+events_unbound22:51:311
6151993225,5cyclictest6389-21apt-get19:11:211
6149993227,4cyclictest71994-21kworker/u8:0+events_unbound21:49:250
6149993227,4cyclictest211167-21kworker/u8:1+events_unbound22:40:250
6151993127,3cyclictest71994-21kworker/u8:0+events_unbound21:31:341
6151993125,5cyclictest157149-21kworker/u8:1+events_unbound22:07:381
6149993127,3cyclictest4168534-21kworker/u8:4+events_unbound20:21:440
6149993127,3cyclictest4168534-21kworker/u8:4+events_unbound20:21:440
6149993127,3cyclictest13206-21kworker/u8:2+events_unbound19:20:340
6149993113,2cyclictest0-21swapper/023:51:350
615599302,11cyclictest172122-21apt-get21:56:212
6151993027,2cyclictest211167-21kworker/u8:1+events_unbound22:37:241
6151993025,4cyclictest71994-21kworker/u8:0+flush-8:021:41:341
6151993025,4cyclictest201675-21kworker/u8:3+flush-8:022:32:481
6151993023,6cyclictest127477-21kworker/u8:3+events_unbound21:36:231
6151993023,3cyclictest3370580-21kworker/u8:1+events_unbound19:51:391
6149993026,3cyclictest127477-21kworker/u8:3+events_unbound21:13:390
614999295,8cyclictest13-21ksoftirqd/020:06:320
614999295,8cyclictest13-21ksoftirqd/020:06:320
6155992824,3cyclictest261044-21unixbench_singl23:21:392
6155992823,3cyclictest76870-21unixbench_singl20:16:402
6155992823,3cyclictest76870-21unixbench_singl20:16:402
6155992724,2cyclictest301653-21fschecks_time00:06:252
6155992723,3cyclictest108156-21fschecks_time20:51:242
6155992723,2cyclictest295629-21unixbench_multi23:56:412
6155992723,2cyclictest28210-21aten2_r5power_c19:31:212
6155992723,2cyclictest13654-21fschecks_time19:16:262
6155992722,3cyclictest62965-21cpuspeed_turbos20:06:232
6155992722,3cyclictest62965-21cpuspeed_turbos20:06:232
6155992722,3cyclictest241962-21fschecks_time23:06:252
6155992722,3cyclictest181371-21unixbench_singl22:01:412
6151992723,3cyclictest246476-21kworker/u8:1+flush-8:000:21:341
6151992722,4cyclictest71994-21kworker/u8:0+events_unbound20:48:181
6155992623,2cyclictest103245-21fschecks_time20:46:252
6155992622,3cyclictest261739-21aten2_r5power_c23:26:222
6155992622,3cyclictest201675-21kworker/u8:3+flush-8:022:46:562
6155992622,2cyclictest276626-21aten2_r5power_v23:41:222
6155992622,2cyclictest187004-21aten2_r5power_e22:11:232
6155992622,2cyclictest18655-21fschecks_time19:21:252
6155992621,3cyclictest137826-21fschecks_time21:21:262
615599261,14cyclictest0-21swapper/220:56:232
615599260,9cyclictest286427-21apt-get23:51:202
615599258,2cyclictest2128182cut22:36:292
615599256,4cyclictest0-21swapper/200:25:002
6155992522,2cyclictest97009-21unixbench_singl20:36:402
6155992520,3cyclictest58118-21fschecks_count20:01:242
6155992520,3cyclictest58118-21fschecks_count20:01:242
6155992519,3cyclictest0-21swapper/223:40:002
615599250,14cyclictest226992-21grep22:51:232
615599250,12cyclictest82828-21apt-get20:26:222
6151992521,3cyclictest3370580-21kworker/u8:1+events_unbound19:56:421
6151992520,3cyclictest176729-21turbostat.cron22:00:001
6151992520,3cyclictest0-21swapper/100:31:281
6151992520,3cyclictest0-21swapper/100:31:281
615599246,5cyclictest0-21swapper/223:14:242
615599243,5cyclictest0-21swapper/221:31:242
615599242,11cyclictest270959-21/usr/sbin/munin23:31:412
615599242,10cyclictest0-21swapper/220:40:052
6155992420,3cyclictest142480-21aten2_r5power_e21:26:232
6155992419,3cyclictest236056-21unixbench_singl22:56:412
615599240,13cyclictest182504-21awk22:06:262
6151992420,2cyclictest5996-21kworker/u8:0+events_unbound19:10:011
57372242,16sleep00-21swapper/019:07:080
615599232,6cyclictest0-21swapper/221:55:002
6155992319,3cyclictest312342-21kthreadcore00:16:272
6155992319,2cyclictest296491-21aten2_r5power_v00:01:222
6155992318,3cyclictest220938-21unixbench_multi22:41:422
6155992313,5cyclictest152317-21apt-get21:36:222
615599230,11cyclictest197079-21df_inode22:21:232
615599226,2cyclictest161rcu_preempt19:56:342
615599224,4cyclictest0-21swapper/223:19:002
615599222,5cyclictest0-21swapper/219:39:052
6155992219,2cyclictest330565-21unixbench_singl00:31:412
6155992219,2cyclictest330565-21unixbench_singl00:31:412
6155992218,2cyclictest306585-21fschecks_time00:11:252
615599219,2cyclictest161rcu_preempt19:11:272
615599217,9cyclictest43007-21apt-get19:46:222
615599215,6cyclictest0-21swapper/222:26:372
615599215,4cyclictest0-21swapper/221:02:242
615599212,4cyclictest0-21swapper/221:06:412
615599212,4cyclictest0-21swapper/219:26:402
615599211,9cyclictest166264-21python321:46:392
6155992116,3cyclictest236792-21aten2_r5power_e23:01:242
6155992115,4cyclictest38238-21cpuspeed19:41:232
6155992112,2cyclictest161rcu_preempt21:41:382
615599210,6cyclictest52703-21sed19:55:012
615599210,10cyclictest131430-21ntp_states21:11:362
615599203,1cyclictest0-21swapper/200:36:322
615599202,9cyclictest0-21swapper/223:46:232
615599202,5cyclictest0-21swapper/222:31:322
615599202,4cyclictest0-21swapper/220:20:022
615599202,4cyclictest0-21swapper/220:20:022
6155992015,3cyclictest88017-21tr20:31:232
615599200,10cyclictest136204-21sed21:16:322
615599194,5cyclictest0-21swapper/222:15:242
615599192,4cyclictest0-21swapper/200:26:352
12472194,9sleep20-21swapper/219:05:012
11512021910,5sleep30-21swapper/320:56:313
2913682183,10sleep30-21swapper/323:56:223
14752183,8sleep30-21swapper/319:06:233
578312162,9sleep30-21swapper/320:01:213
578312162,9sleep30-21swapper/320:01:213
2511732142,7sleep30-21swapper/323:15:013
2453752142,8sleep30-21swapper/323:06:343
1028652142,8sleep30-21swapper/320:46:203
3134282132,6sleep30-21swapper/300:16:293
2607832132,7sleep30-21swapper/323:21:393
1817232132,6sleep30-21swapper/322:05:023
1569462132,6sleep30-21swapper/321:40:023
930172122,6sleep30-21swapper/320:36:253
828022120,8sleep30-21swapper/320:26:223
675732122,6sleep30-21swapper/320:10:243
627452122,6sleep30-21swapper/320:06:233
627452122,6sleep30-21swapper/320:06:233
567962122,6sleep30-21swapper/319:56:403
3358212122,5sleep30-21swapper/300:40:003
3213642122,6sleep30-21swapper/300:26:243
3167962122,6sleep30-21swapper/300:21:263
3062742122,6sleep30-21swapper/300:11:233
2860642122,6sleep30-21swapper/323:50:003
281502122,6sleep30-21swapper/319:31:203
2783422122,6sleep30-21swapper/323:41:293
2663732122,5sleep30-21swapper/323:30:023
2624382122,6sleep30-21swapper/323:26:283
229872122,6sleep30-21swapper/319:25:023
2236852123,5sleep30-21swapper/322:46:313
1924602122,6sleep30-21swapper/322:16:303
1869512122,6sleep30-21swapper/322:11:243
1622362122,6sleep30-21swapper/321:46:243
1527972122,6sleep30-21swapper/321:36:283
1375132122,6sleep30-21swapper/321:21:243
1341892122,6sleep30-21swapper/321:16:303
1316392122,6sleep30-21swapper/321:11:403
1224262122,6sleep30-21swapper/321:05:023
113722122,5sleep30-21swapper/319:15:023
1116992122,6sleep30-21swapper/320:51:383
980762112,6sleep30-21swapper/320:41:263
877942112,5sleep30-21swapper/320:31:233
817942112,5sleep30-21swapper/320:21:403
817942112,5sleep30-21swapper/320:21:403
730462112,6sleep30-21swapper/320:16:263
730462112,6sleep30-21swapper/320:16:263
72722112,6sleep30-21swapper/319:11:293
478152113,5sleep30-21swapper/319:50:063
384952112,5sleep30-21swapper/319:41:273
327732112,5sleep30-21swapper/319:35:013
3259892112,5sleep30-21swapper/300:30:013
3259892112,5sleep30-21swapper/300:30:013
3010102112,5sleep30-21swapper/300:05:013
2963012112,5sleep30-21swapper/300:00:393
2863402112,5sleep30-21swapper/323:50:323
2715322113,5sleep30-21swapper/323:36:043
2521162112,5sleep30-21swapper/323:16:253
2367392112,5sleep30-21swapper/323:01:243
2305332112,5sleep30-21swapper/322:51:333
2163622112,5sleep30-21swapper/322:40:013
2116162112,5sleep30-21swapper/322:35:403
2066032112,6sleep30-21swapper/322:30:023
2063772113,5sleep30-21swapper/322:29:503
2001712112,5sleep30-21swapper/322:21:313
1770542113,5sleep30-21swapper/322:01:043
1725622112,5sleep30-21swapper/321:56:273
1680762112,5sleep30-21swapper/321:51:293
1472522112,5sleep30-21swapper/321:30:023
1465902112,5sleep30-21swapper/321:26:413
1179982112,5sleep30-21swapper/321:01:253
428852102,5sleep30-21swapper/319:45:083
181782102,5sleep30-21swapper/319:20:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional