You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-22 - 23:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Sun Mar 22, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
111127121610,2sleep3471rcuc/312:06:393
107538821530,3sleep375-21kworker/3:1+events11:31:403
103020921010,0chrt201rcuc/010:46:380
9048332860,6chrt0-21swapper/108:41:351
8541202650,3sleep375-21kworker/3:1-events07:46:483
9328972540,6chrt0-21swapper/209:06:402
813034995347,4cyclictest780480-21kworker/u8:3+events_unbound07:15:051
813034995347,4cyclictest780480-21kworker/u8:3+events_unbound07:15:041
813034995247,3cyclictest1038441-21kworker/u8:2+events_unbound12:21:391
813034995246,5cyclictest941777-21kworker/u8:3+events_unbound11:05:011
813034995041,7cyclictest1082989-21latency_hist11:40:011
8401702490,5sleep1840171-21aten2_r5power_e07:36:311
813034994943,4cyclictest1057246-21kworker/u8:1+events_unbound11:50:001
813034994940,6cyclictest869564-21latency_hist08:05:011
813038994743,3cyclictest1003816-21kworker/u8:1+flush-8:010:21:472
813034994741,4cyclictest1038441-21kworker/u8:2+events_unbound11:55:001
813034994641,3cyclictest988997-21kworker/u8:0+events_unbound11:41:471
813034994640,4cyclictest770542-21kworker/u8:1+events_unbound07:26:471
813034994638,6cyclictest988997-21kworker/u8:0+flush-8:010:51:371
813034994540,3cyclictest1038441-21kworker/u8:2+events_unbound12:05:001
813034994538,5cyclictest820054-21kworker/u8:2+flush-8:008:51:491
813034994538,5cyclictest820054-21kworker/u8:2+flush-8:008:51:491
813031994535,7cyclictest978803-21latency_hist09:55:010
813034994439,4cyclictest820054-21kworker/u8:2+events_unbound09:30:011
813034994437,5cyclictest780480-21kworker/u8:3+flush-8:007:11:471
813034994437,5cyclictest1038441-21kworker/u8:2+flush-8:011:16:431
813031994435,6cyclictest817870-21latency_hist07:15:000
813038994338,3cyclictest820054-21kworker/u8:2+flush-8:009:16:472
813034994338,3cyclictest963972-21kworker/u8:1+flush-8:009:46:341
813034994337,5cyclictest974096-21kworker/u8:0+flush-8:009:56:371
813034994336,5cyclictest1038441-21kworker/u8:2+flush-8:010:56:341
813034994335,6cyclictest820054-21kworker/u8:2+flush-8:008:36:471
813034994237,3cyclictest820054-21kworker/u8:2+events_unbound08:56:391
813034994234,6cyclictest1093102-21kworker/u8:3+flush-8:012:11:421
81303199421,39cyclictest1-21systemd07:20:000
81303199421,39cyclictest1-21systemd07:20:000
813034994136,3cyclictest820054-21kworker/u8:2+events_unbound09:36:361
813034994136,3cyclictest1038441-21kworker/u8:2+flush-8:011:11:381
813034994135,5cyclictest1003816-21kworker/u8:1+flush-8:010:21:421
813034994134,5cyclictest1093102-21kworker/u8:3+events_unbound12:06:431
813034994132,7cyclictest899211-21latency_hist08:35:011
813038994035,4cyclictest844769-21idleruntime-cro07:40:002
813034994036,3cyclictest1057246-21kworker/u8:1+events_unbound11:21:491
813034994035,4cyclictest854927-21kworker/u8:3+events_unbound07:55:011
813034993934,4cyclictest820054-21kworker/u8:2+events_unbound09:21:311
813034993932,5cyclictest988997-21kworker/u8:0+flush-8:010:41:481
813034993932,5cyclictest988997-21kworker/u8:0+flush-8:010:41:481
813034993932,4cyclictest1013474-21latency_hist10:30:011
813034993931,6cyclictest1137935-21latency_hist12:35:001
813034993834,3cyclictest820054-21kworker/u8:2+flush-8:010:16:491
813034993833,4cyclictest988997-21kworker/u8:0+events_unbound11:06:331
813034993732,4cyclictest919173-21kworker/u8:1+events_unbound09:16:331
813034993729,6cyclictest1133001-21latency_hist12:30:001
813034993727,7cyclictest280-21systemd-journal07:57:141
813034993631,4cyclictest854927-21kworker/u8:3+flush-8:008:16:361
813034993629,5cyclictest1018410-21latency_hist10:35:011
813031993628,5cyclictest280-21systemd-journal07:30:280
813031993627,7cyclictest848908-21ntpq07:41:420
813038993530,3cyclictest941777-21kworker/u8:3+events_unbound09:41:462
813038993530,3cyclictest1123033-21latency_hist12:20:002
813034993529,5cyclictest1132434-21kworker/u8:1+flush-8:012:36:491
813034993529,5cyclictest1132434-21kworker/u8:1+flush-8:012:36:491
813034993529,4cyclictest854927-21kworker/u8:3+events_unbound08:06:331
813034993527,6cyclictest941777-21kworker/u8:3+flush-8:009:31:401
813034993527,6cyclictest849455-21grep07:41:481
813034993527,6cyclictest1038441-21kworker/u8:2+flush-8:011:26:371
813038993431,2cyclictest879455-21apt08:15:002
813038993430,3cyclictest1003816-21kworker/u8:1+flush-8:010:31:422
813034993430,3cyclictest963972-21kworker/u8:1+events_unbound09:40:381
813034993429,3cyclictest1038441-21kworker/u8:2+events_unbound11:56:411
813034993428,4cyclictest820054-21kworker/u8:2+events_unbound10:06:361
813034993428,4cyclictest820054-21kworker/u8:2+events_unbound07:21:451
813034993423,8cyclictest933802-21true09:10:011
813038993328,3cyclictest958510-21apt-get09:35:002
813038993326,5cyclictest1083320-21cat11:40:012
813038993324,7cyclictest280-21systemd-journal10:20:002
813034993327,4cyclictest1003816-21kworker/u8:1+flush-8:010:36:371
813031993326,4cyclictest889342-21latency_hist08:25:010
813031993325,6cyclictest958506-21latency_hist09:35:010
81303199331,29cyclictest1063024-21munin-run11:20:020
8082502333,6sleep10-21swapper/107:06:181
813038993227,3cyclictest870146-21cpuspeed_turbos08:06:322
813034993226,4cyclictest864631-21kworker/u8:0+flush-8:008:11:391
813031993225,5cyclictest854927-21kworker/u8:3+flush-8:007:56:350
813031993223,6cyclictest998988-21/usr/sbin/munin10:16:480
813034993126,4cyclictest854927-21kworker/u8:3+events_unbound08:46:431
813034993125,4cyclictest820054-21kworker/u8:2+events_unbound08:26:411
813034993123,6cyclictest1078077-21latency_hist11:35:011
813031993122,6cyclictest1008539-21latency_hist10:25:010
813038993025,3cyclictest1013178-21unixbench_singl10:26:492
813034993024,4cyclictest889359-21systemd-run08:25:001
813031993025,3cyclictest401-21dbus-daemon08:10:000
813031993020,8cyclictest1098632-21diskstats11:56:340
8896962290,2chrt451irq_work/308:26:293
813038992926,2cyclictest839477-21unixbench_singl07:31:522
813038992925,2cyclictest963707-21systemctl09:40:002
813038992924,4cyclictest854927-21kworker/u8:3+flush-8:008:41:392
813034992923,5cyclictest974096-21kworker/u8:0+flush-8:009:51:441
813031992922,5cyclictest280-21systemd-journal09:00:510
813034992824,2cyclictest1029404-21irqrtprio10:46:371
813031992822,4cyclictest280-21systemd-journal10:25:130
813038992721,4cyclictest834895-21gpgv07:30:012
813038992719,6cyclictest280-21systemd-journal11:15:002
813038992718,6cyclictest1062947-21turbostat.cron11:20:002
813034992723,3cyclictest998654-21munin-run10:15:001
813031992723,3cyclictest820054-21kworker/u8:2+flush-8:008:31:460
813031992723,3cyclictest1043157-21cron11:00:000
813031992723,2cyclictest0-21swapper/008:20:000
813038992621,3cyclictest1083829-21cpuspeed_turbos11:41:322
813038992621,3cyclictest1028976-21fschecks_count10:46:342
813038992620,4cyclictest1047799-21unixbench_multi11:01:482
813038992620,4cyclictest1043165-21sendmail11:00:002
813038992618,6cyclictest893922-21unixbench_multi08:26:492
813034992619,5cyclictest984011-21kworker/u8:1+events_unbound10:01:411
813031992622,3cyclictest859673-21systemd-run07:55:010
813031992622,2cyclictest0-21swapper/010:40:000
813031992621,3cyclictest993367-21unixbench_multi10:06:480
813031992620,4cyclictest1092801-21unixbench_singl11:46:490
813038992521,3cyclictest1138410-21aten2_r5power_v12:36:322
813038992521,3cyclictest1138410-21aten2_r5power_v12:36:322
813038992521,3cyclictest1038441-21kworker/u8:2+events_unbound12:26:372
813038992521,2cyclictest993689-21turbostat.cron10:10:002
813038992521,2cyclictest1053071-21systemd-run11:10:012
813034992521,3cyclictest854927-21kworker/u8:3+events_unbound09:01:311
813034992520,4cyclictest928071-21kworker/u8:0+events_unbound09:11:401
813034992519,5cyclictest770542-21kworker/u8:1+events_unbound07:46:461
813034992518,6cyclictest770542-21kworker/u8:1+events_unbound07:30:021
813031992521,3cyclictest829352-21unixbench_multi07:21:500
813031992521,2cyclictest938733-21cron09:15:000
813031992521,2cyclictest1132986-21cron12:30:000
813031992520,4cyclictest1072775-21unixbench_multi11:26:490
813031992520,3cyclictest1038202-21cron10:55:000
813031992520,3cyclictest1027979-21unixbench_multi10:41:490
813031992520,3cyclictest1027979-21unixbench_multi10:41:490
813031992519,4cyclictest1-21systemd08:15:000
813031992517,6cyclictest1093102-21kworker/u8:3+flush-8:012:06:450
9275672240,6sleep30-21swapper/309:01:403
813038992420,2cyclictest1068605-21aten2_r5power_e11:26:302
813038992418,4cyclictest0-21swapper/209:21:402
813038992415,7cyclictest280-21systemd-journal07:15:002
813031992420,3cyclictest1108111-21kworker/u8:0+flush-8:012:12:190
813031992420,3cyclictest1079030-21sort11:36:360
813031992420,2cyclictest0-21swapper/011:55:000
813031992420,2cyclictest0-21swapper/008:51:380
813031992420,2cyclictest0-21swapper/008:51:380
813031992419,4cyclictest973605-21latency_hist09:50:010
813031992417,5cyclictest280-21systemd-journal09:25:540
813038992320,2cyclictest994320-21fschecks_count10:11:332
813038992320,2cyclictest914750-21fschecks_time08:51:362
813038992320,2cyclictest914750-21fschecks_time08:51:362
813038992320,2cyclictest849404-21unixbench_multi07:41:482
813038992319,3cyclictest1108111-21kworker/u8:0+flush-8:012:21:452
813038992313,7cyclictest973904-21cat09:50:012
81303899231,2cyclictest8503482tr07:46:342
813034992319,3cyclictest1108111-21kworker/u8:0+events_unbound12:15:381
813031992318,4cyclictest854927-21kworker/u8:3+events_unbound08:01:400
813031992318,3cyclictest0-21swapper/007:50:010
813031992312,9cyclictest0-21swapper/009:41:300
81303199230,22cyclictest829931-21sshd07:25:130
813038992219,2cyclictest938446-21unixbench_singl09:11:522
813038992218,3cyclictest879902-21aten2_r5power_p08:16:312
813038992218,3cyclictest1088851-21fschecks_time11:46:332
813038992218,2cyclictest1018999-21cpuspeed_turbos10:36:322
813038992218,2cyclictest0-21swapper/208:36:402
81303899221,11cyclictest1136932-21latency12:31:422
81303199222,19cyclictest0-21swapper/011:06:470
813031992218,3cyclictest908797-21unixbench_singl08:41:510
813031992218,2cyclictest0-21swapper/012:20:000
813031992218,2cyclictest0-21swapper/012:01:310
813031992217,4cyclictest923941-21sh09:00:000
813031992217,4cyclictest20977-21cron12:35:000
813031992217,4cyclictest1067849-21unixbench_multi11:21:500
813031992217,3cyclictest0-21swapper/012:20:030
813031992214,1cyclictest0-21swapper/010:01:280
813031992213,7cyclictest820054-21kworker/u8:2+flush-8:009:36:440
8082642222,16sleep0808280-21acpi07:06:290
813038992118,2cyclictest984226-21aten2_r5power_p10:01:302
813038992116,3cyclictest923895-21idleruntime-cro09:00:002
813038992116,3cyclictest1102067-21needreboot11:56:412
81303199215,3cyclictest10449622cut11:01:370
813031992117,2cyclictest944570-21irqcore09:21:360
813031992117,2cyclictest0-21swapper/012:36:410
813031992117,2cyclictest0-21swapper/012:36:410
813031992117,2cyclictest0-21swapper/011:45:000
813031992115,3cyclictest0-21swapper/008:36:300
81303899202,13cyclictest979164-21apt-get09:56:312
813038992012,6cyclictest894643-21apt-get08:31:292
81303899201,14cyclictest864970-21apt-get08:01:312
813031992016,3cyclictest840727-21sed07:36:360
813031992016,3cyclictest1018052-21unixbench_multi10:31:480
813031992016,2cyclictest0-21swapper/008:30:000
813031992015,3cyclictest0-21swapper/009:56:480
813031992013,5cyclictest932954-21ntpq09:06:420
9569052190,3chrt75-21kworker/3:1+events09:31:373
813038991916,2cyclictest1108360-21aten2_r5power_v12:06:312
813038991915,2cyclictest0-21swapper/208:46:302
813038991915,2cyclictest0-21swapper/207:21:482
813038991910,7cyclictest1114515-21cut12:11:372
813031991916,2cyclictest0-21swapper/010:11:500
813031991915,2cyclictest0-21swapper/009:16:480
81303199191,13cyclictest589-21runrttasks11:11:300
8243952180,6chrt451irq_work/307:16:503
8243952180,6chrt451irq_work/307:16:503
81303899187,10cyclictest820054-21kworker/u8:2+flush-8:009:01:442
81303899182,4cyclictest0-21swapper/207:56:362
813038991814,2cyclictest0-21swapper/209:51:332
813038991814,2cyclictest0-21swapper/208:21:372
813038991813,4cyclictest820054-21kworker/u8:2+flush-8:007:15:362
813038991813,4cyclictest820054-21kworker/u8:2+flush-8:007:15:362
81303899181,2cyclictest10343632grep10:51:402
81303899181,12cyclictest1063569-21apt-get11:21:312
81303899180,2cyclictest161rcu_preempt10:41:382
81303899180,2cyclictest161rcu_preempt10:41:382
813031991813,3cyclictest0-21swapper/011:31:320
8082102183,8sleep30-21swapper/307:05:483
8081842184,10sleep20-21swapper/207:05:262
81303899173,2cyclictest421rcuog/209:26:282
813038991713,2cyclictest0-21swapper/211:51:492
813038991713,2cyclictest0-21swapper/207:51:342
813038991712,4cyclictest988997-21kworker/u8:0+events_unbound11:30:062
813031991713,2cyclictest0-21swapper/008:46:370
10369012170,3sleep375-21kworker/3:1+events10:51:433
9791672162,9sleep30-21swapper/309:56:303
81303899162,13cyclictest0-21swapper/212:01:302
9843792132,7sleep30-21swapper/310:01:323
9735932132,7sleep30-21swapper/309:50:003
9643302132,7sleep30-21swapper/309:41:343
9595902132,7sleep30-21swapper/309:36:363
9479862132,7sleep30-21swapper/309:21:473
9387282132,6sleep30-21swapper/309:15:013
8547842132,6sleep30-21swapper/307:50:023
9979252122,6sleep30-21swapper/310:11:473
9894562122,6sleep30-21swapper/310:06:343
9429232122,6sleep30-21swapper/309:16:463
9238872121,6sleep30-21swapper/309:00:003
9144052122,6sleep30-21swapper/308:51:343
9144052122,6sleep30-21swapper/308:51:343
9132672122,6sleep30-21swapper/308:46:443
8950212122,6sleep30-21swapper/308:31:353
8796902122,6sleep30-21swapper/308:15:143
8645702122,5sleep30-21swapper/308:00:013
8456122122,6sleep30-21swapper/307:41:353
8392812122,6sleep30-21swapper/307:31:523
8273062122,6sleep30-21swapper/307:21:413
8135832122,6sleep30-21swapper/307:11:343
11390812120,7sleep30-21swapper/312:36:383
11390812120,7sleep30-21swapper/312:36:383
11370722122,6sleep30-21swapper/312:31:443
11128832122,5sleep30-21swapper/312:10:013
11070322122,6sleep30-21swapper/312:01:423
10984152122,6sleep30-21swapper/311:56:333
10980022122,6sleep30-21swapper/311:55:003
10873822122,6sleep30-21swapper/311:41:453
10782312122,6sleep30-21swapper/311:35:023
10685522122,6sleep30-21swapper/311:26:313
10676252122,6sleep30-21swapper/311:21:503
10587522122,6sleep30-21swapper/311:16:363
10530972122,6sleep30-21swapper/311:10:023
10430952122,6sleep30-21swapper/310:59:143
10323972122,6sleep30-21swapper/310:46:423
10176782122,6sleep30-21swapper/310:31:463
10126712122,6sleep30-21swapper/310:26:443
10042352122,6sleep30-21swapper/310:21:343
9747242112,5sleep30-21swapper/309:51:373
9532762112,5sleep30-21swapper/309:26:493
9288482111,6sleep30-21swapper/309:05:023
9043882112,5sleep30-21swapper/308:40:023
8995512112,5sleep30-21swapper/308:36:293
8846432112,6sleep30-21swapper/308:20:123
8786392112,5sleep30-21swapper/308:11:453
8702982112,5sleep30-21swapper/308:06:353
8600202112,5sleep30-21swapper/307:56:323
8401382113,5sleep30-21swapper/307:36:303
8322072112,5sleep30-21swapper/307:26:393
11282622112,5sleep30-21swapper/312:25:023
11260722112,5sleep30-21swapper/312:21:413
11218742112,5sleep30-21swapper/312:16:433
10881832111,5sleep30-21swapper/311:45:013
10487532112,5sleep30-21swapper/311:06:333
10435582112,6sleep30-21swapper/311:01:313
10187792112,5sleep30-21swapper/310:36:313
10029832110,7sleep30-21swapper/310:16:493
10236342102,5sleep30-21swapper/310:40:043
10236342102,5sleep30-21swapper/310:40:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional