You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-12 - 20:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Sun Apr 12, 2026 12:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
5686532690,1chrt568656-21sed11:26:212
5496632570,2sleep3481ktimers/311:06:243
4086732530,2sleep375-21kworker/3:1+events08:46:223
6312162520,2chrt0-21swapper/212:26:252
310769994942,5cyclictest342371-21latency_hist07:40:011
6369292480,4sleep0201rcuc/012:31:320
310769994839,6cyclictest327528-21latency_hist07:25:001
310769994839,6cyclictest327528-21latency_hist07:25:001
310767994734,10cyclictest280-21systemd-journal09:55:010
310767994637,7cyclictest280-21systemd-journal12:01:200
3078032450,37sleep2308809-21cut07:06:262
310767994135,4cyclictest412407-21latency_hist08:50:010
4165112400,1chrt416512-21ntpq08:51:290
310769994032,6cyclictest477586-21cp09:55:011
310769994031,6cyclictest627310-21apt-get12:25:011
310767993933,4cyclictest588080-21apt-get11:46:140
310767993928,8cyclictest280-21systemd-journal11:20:000
31076799391,34cyclictest407292-21munin-run08:45:000
310767993831,5cyclictest387150-21cron08:25:000
310769993730,5cyclictest280-21systemd-journal07:40:241
310769993728,6cyclictest280-21systemd-journal09:43:221
310767993729,6cyclictest483007-21kworker/u8:1+flush-8:010:46:320
310767993632,3cyclictest372529-21kworker/u8:2+flush-8:008:36:270
310767993631,4cyclictest382432-21kworker/u8:3+flush-8:009:01:190
310767993630,4cyclictest327179-21grep07:21:340
310767993630,4cyclictest327179-21grep07:21:340
310769993530,3cyclictest538914-21irqrtprio10:56:221
310769993526,6cyclictest592675-21latency_hist11:50:011
310767993530,3cyclictest372529-21kworker/u8:2+flush-8:009:36:310
310767993530,3cyclictest372529-21kworker/u8:2+flush-8:009:36:310
310772993429,3cyclictest582548-21apt-get11:40:002
310769993430,3cyclictest0-21swapper/111:55:001
310769993430,3cyclictest0-21swapper/111:55:001
310769993428,4cyclictest280-21systemd-journal08:23:201
310769993427,5cyclictest642374-21latency_hist12:40:001
310769993425,7cyclictest508175-21/usr/sbin/munin10:26:261
310767993429,3cyclictest377592-21apt-get08:16:150
310767993427,5cyclictest512782-21cron10:30:000
310767993425,7cyclictest315678-21latency_hist07:15:010
310767993325,5cyclictest552663-21apt-get11:10:000
310767993320,11cyclictest462733-21kworker/u8:0+flush-8:009:56:370
310769993227,4cyclictest382432-21kworker/u8:3+flush-8:008:36:341
310767993227,3cyclictest432618-21kworker/u8:1+flush-8:009:26:190
310767993227,3cyclictest432618-21kworker/u8:1+flush-8:009:26:190
310767993225,5cyclictest546859-21ntpq11:01:270
310767993225,5cyclictest347476-21cat07:45:010
310767993224,5cyclictest617391-21latency_hist12:15:010
310767993223,7cyclictest417916-21diskstats08:56:180
310772993126,3cyclictest280-21systemd-journal12:10:012
310772993125,4cyclictest422286-21apt-get09:00:002
310769993126,3cyclictest448300-21irqrtprio09:26:221
310769993126,3cyclictest448300-21irqrtprio09:26:221
310767993126,3cyclictest463386-21irqcore09:41:220
310767993122,6cyclictest601699-21ntpq11:56:280
310767993122,6cyclictest601699-21ntpq11:56:280
4846722300,5sleep3451irq_work/310:01:233
310769993020,8cyclictest280-21systemd-journal11:06:221
310769993016,3cyclictest0-21swapper/111:16:191
310767993025,3cyclictest537857-21kworker/u8:2+flush-8:011:41:360
310767993024,4cyclictest442647-21apt-get09:21:140
310767993023,5cyclictest582545-21cron11:40:000
31076799301,27cyclictest622392-21kworker/0:2+events12:25:510
310772992924,3cyclictest532315-21unixbench_singl10:46:342
310769992922,5cyclictest372633-21apt-get08:11:151
310769992921,6cyclictest280-21systemd-journal12:26:221
310767992922,5cyclictest612445-21cron12:10:010
310767992922,5cyclictest572681-21kworker/u8:3+flush-8:012:16:320
310767992921,6cyclictest572681-21kworker/u8:3+flush-8:011:31:270
310767992920,6cyclictest3671301-21kworker/u8:1+flush-8:007:16:300
310772992825,2cyclictest558235-21aten2_r5power_e11:16:172
310772992822,4cyclictest381275-21needreboot08:16:262
310772992816,10cyclictest280-21systemd-journal08:11:202
310769992825,2cyclictest321669-21needreboot07:16:261
310769992823,4cyclictest310761-21cyclictest09:46:311
310769992823,3cyclictest457908-21cpuspeed_turbos09:36:171
310769992823,3cyclictest457908-21cpuspeed_turbos09:36:171
310769992820,6cyclictest280-21systemd-journal10:20:221
310769992820,5cyclictest427464-21latency_hist09:05:011
310767992822,4cyclictest499745-21kthreadcore10:16:220
310767992821,5cyclictest472426-21kworker/u8:2+flush-8:010:11:330
310767992821,5cyclictest401-21dbus-daemon10:55:000
310767992820,6cyclictest456761-21unixbench_multi09:31:350
310767992820,6cyclictest456761-21unixbench_multi09:31:350
310772992723,3cyclictest433660-21kthreadcore09:11:232
310772992723,2cyclictest472774-21aten2_r5power_c09:51:162
310772992722,3cyclictest347017-21unixbench_singl07:41:362
310772992721,4cyclictest512417-21unixbench_multi10:26:342
310772992717,8cyclictest407246-21apt-get08:45:002
310772992717,7cyclictest462826-21munin-node09:41:152
310769992723,2cyclictest528734-21irqrtprio10:46:211
310769992722,4cyclictest531854-21kworker/u8:3+flush-8:011:01:331
310769992721,4cyclictest577655-21systemd-run11:35:001
310769992721,4cyclictest422517-21latency_hist09:00:011
310769992720,5cyclictest587448-21unixbench_singl11:41:361
310769992717,7cyclictest0-21swapper/111:10:031
310767992721,4cyclictest527774-21latency_hist10:45:010
310767992720,5cyclictest3671301-21kworker/u8:1+flush-8:007:31:190
5631432260,5sleep3451irq_work/311:21:173
310772992620,4cyclictest453421-21kthreadcore09:31:232
310772992620,4cyclictest453421-21kthreadcore09:31:232
310772992620,4cyclictest428037-21cpuspeed_turbos09:06:192
310772992620,4cyclictest412038-21unixbench_multi08:46:352
310772992620,4cyclictest364911-21kthreadcore08:01:232
310769992622,3cyclictest429963-21kthreadcore09:06:251
310769992622,3cyclictest362419-21systemd-run08:00:011
310769992622,2cyclictest0-21swapper/112:01:221
310769992614,10cyclictest280-21systemd-journal10:30:221
310767992621,4cyclictest472097-21unixbench_singl09:46:340
310767992621,3cyclictest596705-21needreboot11:51:250
310767992621,3cyclictest596705-21needreboot11:51:240
310767992621,3cyclictest518432-21fschecks_time10:36:190
310767992615,9cyclictest0-21swapper/011:11:160
3059912265,15sleep00-21swapper/007:05:150
310772992522,2cyclictest587381-21unixbench_multi11:41:362
310772992521,3cyclictest367784-21aten2_r5power_p08:06:172
310772992521,2cyclictest457797-21aten2_r5power_v09:36:162
310772992521,2cyclictest457797-21aten2_r5power_v09:36:162
310772992520,3cyclictest542413-21unixbench_multi10:56:342
310772992520,3cyclictest522313-21unixbench_multi10:36:332
310772992519,4cyclictest638029-21cpuspeed_turbos12:36:162
310772992519,4cyclictest527339-21unixbench_singl10:41:362
310772992517,6cyclictest399802-21kthreadcore08:36:262
31076999259,4cyclictest0-21swapper/110:43:081
31076999259,3cyclictest0-21swapper/108:34:301
310769992521,3cyclictest1-21systemd10:10:011
310769992520,3cyclictest413482-21irqrtprio08:51:221
310769992518,5cyclictest347919-21apt-get07:46:141
310769992517,6cyclictest311014-21apt-get07:11:141
310769992517,6cyclictest280-21systemd-journal12:34:221
310767992521,2cyclictest517761-21cron10:35:000
310767992521,2cyclictest0-21swapper/007:40:010
310767992520,4cyclictest422760-21kworker/u8:0+flush-8:009:06:210
310767992520,3cyclictest626959-21unixbench_multi12:21:340
310767992520,3cyclictest531854-21kworker/u8:3+events_unbound11:21:260
310767992519,4cyclictest372666-21tr08:11:170
310767992518,5cyclictest397050-21apt-get08:34:590
310767992513,2cyclictest0-21swapper/008:06:300
310772992421,2cyclictest322206-21unixbench_multi07:16:342
310772992420,2cyclictest637144-21unixbench_singl12:31:332
310772992419,3cyclictest536911-21needreboot10:51:252
310772992419,3cyclictest0-21swapper/207:21:222
310772992419,3cyclictest0-21swapper/207:21:222
310772992415,6cyclictest397463-21cat08:35:012
310769992420,3cyclictest622003-21unixbench_singl12:16:331
310769992420,2cyclictest0-21swapper/109:56:221
310769992420,2cyclictest0-21swapper/108:15:201
310769992418,4cyclictest571792-21ntp_kernel_err11:26:271
310769992417,5cyclictest367013-21unixbench_multi08:01:331
310769992417,5cyclictest301058-21kworker/u8:0+flush-8:008:06:201
310769992416,6cyclictest406923-21grep08:41:351
310769992415,7cyclictest280-21systemd-journal08:45:221
310769992412,9cyclictest280-21systemd-journal08:27:201
310769992410,2cyclictest0-21swapper/110:04:241
310767992420,3cyclictest0-21swapper/010:25:010
310767992420,2cyclictest492069-21mailstats10:06:320
310767992419,3cyclictest572642-21cron11:30:000
310767992419,3cyclictest0-21swapper/010:05:000
310772992319,2cyclictest617948-21cpuspeed_turbos12:16:162
310772992319,2cyclictest348033-21aten2_r5power_v07:46:162
310772992319,2cyclictest315315-21unixbench_multi07:11:342
310772992318,4cyclictest607502-21munin-plugin-st12:05:002
310772992317,4cyclictest554160-21kthreadcore11:11:202
31076999238,3cyclictest0-21swapper/109:13:551
310769992319,2cyclictest0-21swapper/110:20:001
310769992319,2cyclictest0-21swapper/109:16:271
310769992318,4cyclictest581945-21mailstats11:36:301
310769992318,3cyclictest0-21swapper/109:31:231
310769992318,3cyclictest0-21swapper/109:31:221
310769992317,3cyclictest0-21swapper/109:21:171
310769992316,5cyclictest493060-21apt-get10:11:131
30698722317,2sleep1307802-21grep07:06:251
310772992218,2cyclictest0-21swapper/210:00:002
310772992217,4cyclictest20977-21cron08:30:002
310772992217,3cyclictest0-21swapper/210:20:002
310772992215,5cyclictest280-21systemd-journal07:30:002
310769992218,2cyclictest0-21swapper/111:56:211
310769992218,2cyclictest0-21swapper/111:56:211
310769992218,2cyclictest0-21swapper/111:21:191
310769992217,3cyclictest0-21swapper/107:51:181
310767992217,3cyclictest542125-21mailstats10:56:320
310767992217,3cyclictest436747-21mailstats09:11:340
310767992216,3cyclictest0-21swapper/007:46:140
31077299216,2cyclictest161rcu_preempt09:16:172
310772992117,3cyclictest543361-21cpuspeed_turbos11:01:172
310772992117,2cyclictest622775-21aten2_r5power_p12:21:172
310772992117,2cyclictest0-21swapper/207:31:332
310772992116,3cyclictest0-21swapper/210:31:332
310769992117,2cyclictest0-21swapper/107:26:341
310769992116,3cyclictest0-21swapper/112:06:181
310767992117,2cyclictest0-21swapper/007:55:000
310767992115,5cyclictest342611-21kworker/u8:3+flush-8:007:56:280
31076799211,14cyclictest391285-21taskset08:26:290
36320922010,6sleep30-21swapper/308:01:213
310772992017,2cyclictest382840-21fschecks_count08:21:182
310772992016,3cyclictest486722-21latency10:01:252
310772992016,3cyclictest372529-21kworker/u8:2+flush-8:009:00:152
310772992016,2cyclictest353075-21cpuspeed_turbos07:51:182
310772992016,2cyclictest338002-21cpuspeed_turbos07:36:172
310772992015,3cyclictest0-21swapper/212:11:222
310772992012,6cyclictest472387-21cron09:49:592
310772992010,8cyclictest0-21swapper/211:21:352
31076999202,17cyclictest0-21swapper/112:14:021
310769992014,4cyclictest0-21swapper/110:36:341
310769992014,4cyclictest0-21swapper/107:31:201
310769992013,5cyclictest0-21swapper/110:51:151
310767992014,4cyclictest301058-21kworker/u8:0+flush-8:008:01:280
31076799201,16cyclictest641560-21ntpq12:36:280
31077299199,7cyclictest507663-21sh10:25:012
31077299192,16cyclictest0-21swapper/211:56:152
31077299192,16cyclictest0-21swapper/211:56:152
310772991915,2cyclictest0-21swapper/208:51:222
310772991910,7cyclictest591389-21tr11:46:252
310767991914,3cyclictest0-21swapper/007:26:190
3105422193,9sleep30-21swapper/307:09:233
310772991814,2cyclictest0-21swapper/210:11:162
310772991813,3cyclictest0-21swapper/211:35:002
310772991813,3cyclictest0-21swapper/210:06:232
310772991812,4cyclictest0-21swapper/209:26:242
310772991812,4cyclictest0-21swapper/209:26:242
310772991811,5cyclictest0-21swapper/211:06:232
31076799189,7cyclictest439530-21cut09:16:220
31077299179,6cyclictest444111-21tr09:21:242
310772991713,2cyclictest0-21swapper/207:56:192
5431402162,9sleep30-21swapper/311:01:153
310772991611,3cyclictest0-21swapper/211:55:002
310772991611,3cyclictest0-21swapper/211:55:002
4466552142,8sleep30-21swapper/309:21:353
4176402142,8sleep30-21swapper/308:56:153
3233152132,7sleep30-21swapper/307:21:203
3233152132,7sleep30-21swapper/307:21:203
6374472122,5sleep30-21swapper/312:35:023
6368652122,6sleep30-21swapper/312:31:323
6281252122,6sleep30-21swapper/312:26:193
6124422122,5sleep30-21swapper/312:10:013
6024772122,6sleep30-21swapper/311:59:223
6024772122,6sleep30-21swapper/311:59:223
5943652123,5sleep30-21swapper/311:51:233
5943652123,5sleep30-21swapper/311:51:233
5803992122,6sleep30-21swapper/311:36:223
5770632122,6sleep30-21swapper/311:31:323
5532412122,6sleep30-21swapper/311:11:143
5378312122,5sleep30-21swapper/310:55:003
5332052122,6sleep30-21swapper/310:51:163
5277622122,5sleep30-21swapper/310:45:023
5189732122,6sleep30-21swapper/310:36:233
5138562122,6sleep30-21swapper/310:31:213
5084562122,6sleep30-21swapper/310:26:203
5026692122,6sleep30-21swapper/310:20:013
4984802122,6sleep30-21swapper/310:16:213
4880722122,6sleep30-21swapper/310:05:533
4815282122,6sleep30-21swapper/309:56:263
4731512122,6sleep30-21swapper/309:51:203
4580302122,6sleep30-21swapper/309:36:203
4580302122,6sleep30-21swapper/309:36:203
4529532122,6sleep30-21swapper/309:31:223
4529532122,6sleep30-21swapper/309:31:223
4479532122,6sleep30-21swapper/309:26:203
4479532122,6sleep30-21swapper/309:26:203
4278172123,6sleep30-21swapper/309:06:183
4228062122,6sleep30-21swapper/309:00:403
4022772122,5sleep30-21swapper/308:40:003
3975062122,6sleep30-21swapper/308:35:043
3871482123,6sleep30-21swapper/308:25:003
3772322122,5sleep30-21swapper/308:15:013
3735202122,6sleep30-21swapper/308:11:243
3676142122,6sleep30-21swapper/308:05:303
3498442123,6sleep30-21swapper/307:46:243
3424062122,6sleep30-21swapper/307:40:023
3381642122,6sleep30-21swapper/307:36:213
3278902122,6sleep30-21swapper/307:26:173
6226952112,5sleep30-21swapper/312:21:173
6177332112,5sleep30-21swapper/312:16:153
6127692112,5sleep30-21swapper/312:11:143
6028042113,5sleep30-21swapper/312:00:183
5877632112,5sleep30-21swapper/311:45:013
5831202112,5sleep30-21swapper/311:41:163
5723222112,5sleep30-21swapper/311:26:353
5618912112,5sleep30-21swapper/311:16:283
5275992112,5sleep30-21swapper/310:44:223
4929392112,5sleep30-21swapper/310:10:023
4676212112,5sleep30-21swapper/309:45:023
4622892112,5sleep30-21swapper/309:40:013
4328792112,5sleep30-21swapper/309:11:193
4144832112,5sleep30-21swapper/308:51:253
3923342112,5sleep30-21swapper/308:30:023
3878562112,5sleep30-21swapper/308:26:213
3619592112,5sleep30-21swapper/307:56:353
3330822112,5sleep30-21swapper/307:31:193
3179302112,6sleep30-21swapper/307:16:143
3108932112,5sleep30-21swapper/307:10:043
4376242102,5sleep30-21swapper/309:15:453
3528552102,5sleep30-21swapper/307:51:173
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional