You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-20 - 12:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Mon Jul 20, 2026 00:44:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
56291821760,3sleep3584-21kworker/3:2+events19:52:253
82936021700,2sleep30-21swapper/300:17:313
7170802660,5sleep20-21swapper/222:27:292
519992996253,7cyclictest766042-21latency_hist23:15:011
519989995847,8cyclictest586861-21latency_hist20:15:000
519997995348,4cyclictest596774-21kworker/u8:3+flush-8:021:12:402
519997995348,3cyclictest617050-21kworker/u8:0+flush-8:021:57:412
519989995141,8cyclictest646861-21/usr/sbin/munin21:17:400
519992995043,5cyclictest686129-21kworker/u8:1+flush-8:023:02:261
519989995045,4cyclictest701052-21kworker/u8:3+flush-8:023:07:390
6997152480,4chrt371rcuc/222:07:302
519997994842,5cyclictest805719-21kworker/u8:1+flush-8:000:27:392
519992994839,6cyclictest576911-21kworker/u8:1+flush-8:020:37:271
519992994839,6cyclictest531725-21latency_hist19:20:011
519997994636,8cyclictest681964-21diskstats21:52:242
519989994642,3cyclictest370357-21kworker/u8:4+flush-8:019:27:400
519989994639,5cyclictest617247-21apt-get20:47:200
519992994432,9cyclictest561201-21ntpq19:47:371
519989994436,6cyclictest740051-21ntpq22:47:330
519992994339,3cyclictest370357-21kworker/u8:4+events_unbound19:37:241
519992994338,4cyclictest701052-21kworker/u8:3+flush-8:022:22:271
519992994338,4cyclictest701052-21kworker/u8:3+flush-8:022:22:271
519992994332,8cyclictest281-21systemd-journal00:31:591
519992994332,8cyclictest281-21systemd-journal00:31:591
519989994338,3cyclictest596774-21kworker/u8:3+flush-8:020:52:390
519989994334,7cyclictest612008-21/usr/sbin/munin20:42:400
519989994334,6cyclictest830832-21latency_hist00:20:010
519989994331,9cyclictest536702-21latency_hist19:25:010
519997994238,3cyclictest776009-21kworker/u8:3+flush-8:000:07:422
519992994233,7cyclictest632047-21/usr/sbin/munin21:02:341
519997994137,3cyclictest725795-21kworker/u8:0+events_unbound22:37:392
519997994137,3cyclictest526989-21kworker/u8:2+events_unbound19:17:382
519992994133,6cyclictest281-21systemd-journal23:17:391
519992994131,7cyclictest581905-21latency_hist20:10:011
519997994035,3cyclictest755932-21kworker/u8:2+events_unbound23:25:032
519992994035,3cyclictest370357-21kworker/u8:4+flush-8:019:52:231
519992994034,4cyclictest596774-21kworker/u8:3+flush-8:021:07:441
519989994036,3cyclictest686129-21kworker/u8:1+flush-8:021:57:260
519989994032,6cyclictest766677-21/usr/sbin/munin23:17:380
519992993930,7cyclictest745770-21apt-get22:55:011
519989993935,3cyclictest576911-21kworker/u8:1+flush-8:020:37:390
519989993935,3cyclictest546772-21kworker/u8:0+flush-8:020:02:400
519989993935,3cyclictest370357-21kworker/u8:4+flush-8:019:57:380
51998999391,34cyclictest745814-21munin-run22:55:010
519997993831,5cyclictest760850-21apt-get23:10:002
519992993831,6cyclictest805719-21kworker/u8:1+events_unbound00:12:411
519992993828,8cyclictest846079-21/usr/sbin/munin00:37:331
519992993828,7cyclictest810847-21latency_hist00:00:011
519989993834,3cyclictest617050-21kworker/u8:0+flush-8:022:07:430
519989993833,3cyclictest805719-21kworker/u8:1+flush-8:000:12:390
519989993731,5cyclictest701052-21kworker/u8:3+flush-8:022:12:370
519989993731,4cyclictest686129-21kworker/u8:1+events_unbound22:32:370
5191592373,28sleep20-21swapper/219:07:392
519997993631,4cyclictest546772-21kworker/u8:0+flush-8:020:27:292
519992993631,4cyclictest686129-21kworker/u8:1+flush-8:022:57:381
5152522363,9sleep10-21swapper/119:06:221
519992993530,4cyclictest576911-21kworker/u8:1+flush-8:020:32:261
519989993530,4cyclictest596774-21kworker/u8:3+events_unbound21:02:420
519989993528,6cyclictest617050-21kworker/u8:0+events_unbound22:02:350
519989993528,5cyclictest805119-21ntpq23:52:340
519989993524,9cyclictest592473-21diskstats20:22:250
519992993429,4cyclictest617050-21kworker/u8:0+flush-8:021:27:101
519992993427,5cyclictest596774-21kworker/u8:3+flush-8:021:16:101
519997993326,5cyclictest681058-21apt-get21:50:002
519992993327,4cyclictest370357-21kworker/u8:4+events_unbound19:42:291
519992993325,6cyclictest536706-21apt-get19:25:001
519989993326,5cyclictest686129-21kworker/u8:1+flush-8:022:17:300
519989993324,6cyclictest800960-21latency_hist23:50:010
519989993322,9cyclictest556749-21apt-get19:45:010
519997993224,6cyclictest572215-21cp20:00:012
519992993228,3cyclictest776009-21kworker/u8:3+flush-8:000:22:261
519992993228,3cyclictest776009-21kworker/u8:3+events_unbound23:55:011
519992993227,4cyclictest805719-21kworker/u8:1+flush-8:000:05:051
519992993226,5cyclictest576911-21kworker/u8:1+flush-8:020:12:431
519992993226,4cyclictest686129-21kworker/u8:1+flush-8:022:17:331
519992993226,4cyclictest370357-21kworker/u8:4+flush-8:019:57:251
519992993225,5cyclictest611625-21kworker/u8:2+events_unbound21:52:391
519989993228,3cyclictest576911-21kworker/u8:1+flush-8:020:32:390
519989993227,4cyclictest755932-21kworker/u8:2+flush-8:023:22:360
519989993227,4cyclictest370357-21kworker/u8:4+flush-8:019:54:040
519989993227,3cyclictest370357-21kworker/u8:4+events_unbound19:15:020
519989993226,4cyclictest796004-21latency_hist23:45:010
519989993226,4cyclictest596774-21kworker/u8:3+events_unbound21:07:420
519989993225,5cyclictest576911-21kworker/u8:1+events_unbound20:17:210
519989993224,6cyclictest641922-21/usr/sbin/munin21:12:410
519992993126,3cyclictest732108-21irqrtprio22:42:281
519992993126,3cyclictest681457-21latency_hist21:50:011
519992993125,4cyclictest830566-21unixbench_multi00:17:411
519989993127,3cyclictest576911-21kworker/u8:1+flush-8:020:07:300
519989993126,4cyclictest611625-21kworker/u8:2+flush-8:021:42:270
519989993124,5cyclictest671180-21cron21:40:000
519989993122,7cyclictest815029-21ntpq00:02:330
519997993024,4cyclictest766145-21gpgv23:15:002
519992993025,4cyclictest755932-21kworker/u8:2+flush-8:023:27:311
519989993026,3cyclictest546772-21kworker/u8:0+flush-8:019:47:400
519989993025,4cyclictest686129-21kworker/u8:1+events_unbound22:57:400
519989993024,5cyclictest611625-21kworker/u8:2+events_unbound20:57:370
519989993021,7cyclictest596774-21kworker/u8:3+flush-8:021:22:400
519989993021,7cyclictest596774-21kworker/u8:3+flush-8:021:22:400
519997992924,3cyclictest725795-21kworker/u8:0+events_unbound22:45:072
519997992919,8cyclictest616595-21apt-get20:45:002
519992992925,3cyclictest611625-21kworker/u8:2+flush-8:020:52:091
519992992925,3cyclictest596774-21kworker/u8:3+flush-8:021:32:401
519992992924,3cyclictest686129-21kworker/u8:1+events_unbound22:00:021
519989992924,4cyclictest805719-21kworker/u8:1+events_unbound00:37:270
519989992923,5cyclictest370357-21kworker/u8:4+flush-8:019:14:050
519989992923,4cyclictest546772-21kworker/u8:0+events_unbound20:27:290
519989992922,5cyclictest805719-21kworker/u8:1+flush-8:023:57:250
519997992824,3cyclictest611625-21kworker/u8:2+flush-8:020:45:472
519997992823,4cyclictest686129-21kworker/u8:1+events_unbound22:03:592
519992992825,2cyclictest1-21systemd23:25:001
519992992824,3cyclictest617968-21irqrtprio20:47:281
519992992824,3cyclictest596472-21unixbench_multi20:22:411
519992992824,3cyclictest522483-21kthreadcore19:12:321
519992992823,4cyclictest686129-21kworker/u8:1+events_unbound22:12:441
519992992823,4cyclictest617050-21kworker/u8:0+flush-8:021:37:271
519992992823,3cyclictest576911-21kworker/u8:1+flush-8:020:42:261
519992992822,1cyclictest546772-21kworker/u8:0+events_unbound20:02:371
519989992824,3cyclictest776009-21kworker/u8:3+flush-8:000:22:390
519989992824,2cyclictest0-21swapper/019:35:000
519989992822,4cyclictest686129-21kworker/u8:1+flush-8:022:24:040
519989992822,4cyclictest686129-21kworker/u8:1+flush-8:022:24:040
7585682270,3sleep10-21swapper/123:07:321
519997992723,2cyclictest806543-21cpuspeed_turbos23:57:232
519997992721,4cyclictest536807-21gpgv19:25:012
519992992722,4cyclictest617050-21kworker/u8:0+flush-8:022:07:381
519992992722,3cyclictest546772-21kworker/u8:0+events_unbound20:30:011
519992992721,4cyclictest791513-21apt-get23:42:211
519989992723,2cyclictest751633-21cpuspeed_turbos23:02:240
519989992722,3cyclictest786739-21cpuspeed_turbos23:37:240
519989992721,4cyclictest596774-21kworker/u8:3+flush-8:021:52:360
63654022619,4sleep30-21swapper/321:04:413
519997992622,2cyclictest582687-21fschecks_time20:12:312
519997992621,3cyclictest766039-21apt-get23:15:022
519997992619,5cyclictest556749-21apt-get19:45:002
519997992619,5cyclictest384-21dbus-daemon20:40:002
519992992622,3cyclictest785262-21needreboot23:32:331
519992992622,3cyclictest730699-21unixbench_singl22:37:421
519992992622,3cyclictest686129-21kworker/u8:1+events_unbound22:27:411
519992992621,4cyclictest576911-21kworker/u8:1+flush-8:020:17:381
519992992620,5cyclictest611625-21kworker/u8:2+flush-8:021:42:311
519992992620,4cyclictest776009-21kworker/u8:3+events_unbound23:37:381
519992992620,4cyclictest776009-21kworker/u8:3+events_unbound00:02:231
519992992619,5cyclictest281-21systemd-journal21:15:001
519989992621,4cyclictest617050-21kworker/u8:0+flush-8:021:27:440
519989992620,5cyclictest725795-21kworker/u8:0+flush-8:023:12:310
519989992616,8cyclictest730163-21ntpq22:37:360
519997992518,5cyclictest281-21systemd-journal20:05:002
519992992521,3cyclictest0-21swapper/121:25:001
519992992521,3cyclictest0-21swapper/121:25:001
519992992518,6cyclictest627431-21fschecks_time20:57:251
519989992520,4cyclictest686129-21kworker/u8:1+events_unbound22:42:230
519989992519,4cyclictest596774-21kworker/u8:3+events_unbound21:47:380
519989992516,7cyclictest844887-21ntpq00:32:320
519989992516,7cyclictest844887-21ntpq00:32:320
519989992512,11cyclictest721110-21date22:30:000
519997992421,2cyclictest602467-21fschecks_time20:32:252
519997992421,2cyclictest0-21swapper/223:45:002
519997992418,4cyclictest821513-21fschecks_time00:12:332
519992992420,2cyclictest0-21swapper/122:47:401
519989992415,7cyclictest781551-21/usr/sbin/munin23:32:400
519997992319,3cyclictest786104-21kworker/u8:1+events_unbound23:35:192
519997992318,4cyclictest467623-21kworker/u8:0+flush-8:019:10:202
519997992317,4cyclictest656077-21unixbench_multi21:22:422
519997992317,4cyclictest656077-21unixbench_multi21:22:422
519989992319,3cyclictest596774-21kworker/u8:3+events_unbound21:33:300
519989992313,8cyclictest839981-21ntpq00:27:350
519997992219,2cyclictest831498-21cpuspeed_turbos00:22:242
519997992219,2cyclictest632387-21fschecks_time21:02:262
519997992217,3cyclictest665939-21unixbench_multi21:32:402
519997992217,3cyclictest0-21swapper/221:00:002
519992992218,2cyclictest0-21swapper/123:47:271
519992992218,2cyclictest0-21swapper/122:02:251
519992992216,4cyclictest805719-21kworker/u8:1+flush-8:000:25:361
519992992216,4cyclictest686129-21kworker/u8:1+events_unbound22:32:301
519989992218,3cyclictest467623-21kworker/u8:0+flush-8:019:10:000
51999799218,11cyclictest371rcuc/222:17:302
51999799212,2cyclictest161rcu_preempt21:45:002
519997992118,2cyclictest826438-21aten2_r5power_v00:17:242
519997992117,3cyclictest705749-21unixbench_singl22:12:432
519997992117,3cyclictest0-21swapper/222:55:012
51999299218,4cyclictest0-21swapper/119:25:411
519992992117,2cyclictest0-21swapper/119:32:321
519989992117,2cyclictest0-21swapper/000:07:260
519989992116,4cyclictest776009-21kworker/u8:3+flush-8:023:27:350
519997992017,2cyclictest587350-21aten2_r5power_e20:17:242
519997992017,2cyclictest547551-21fschecks_time19:37:272
519997992016,3cyclictest596774-21kworker/u8:3+flush-8:021:15:152
51999799200,9cyclictest843431-21cut00:32:302
51999799200,9cyclictest843431-21cut00:32:302
519989992016,2cyclictest546772-21kworker/u8:0+events_unbound19:35:030
519997991916,2cyclictest771947-21fschecks_count23:22:252
519997991916,2cyclictest746539-21aten2_r5power_v22:57:232
519997991916,2cyclictest546514-21unixbench_multi19:32:422
5192112193,9sleep30-21swapper/319:07:403
68660221811,4sleep30-21swapper/321:57:213
6848922180,2sleep3584-21kworker/3:2-events21:52:303
6008362189,5sleep30-21swapper/320:27:333
51999799182,4cyclictest0-21swapper/221:07:372
51999799182,2cyclictest161rcu_preempt00:37:412
519997991812,4cyclictest562334-21apt-get19:52:182
519997991810,6cyclictest726034-21grep22:35:012
51999799180,8cyclictest161rcu_preempt20:55:002
51999799180,2cyclictest161rcu_preempt22:42:252
51999799179,6cyclictest371rcuc/223:52:292
51999799172,11cyclictest800221-21ntpq23:47:352
519997991713,2cyclictest0-21swapper/223:32:352
519997991713,2cyclictest0-21swapper/223:02:412
519997991713,2cyclictest0-21swapper/221:25:212
51999799170,4cyclictest514947-21kworker/2:0+events20:22:392
51999799167,7cyclictest538018-21sed19:27:302
51999799162,2cyclictest0-21swapper/200:02:322
519997991613,2cyclictest668833-21kthreadcore21:37:312
519997991611,3cyclictest0-21swapper/222:22:262
519997991611,3cyclictest0-21swapper/222:22:262
51999799160,3cyclictest560917-21kthreadcore19:47:332
7980552152,9sleep30-21swapper/323:47:313
519997991512,2cyclictest0-21swapper/220:05:162
7565872132,7sleep30-21swapper/323:07:263
7202532133,6sleep30-21swapper/322:27:343
6972022132,7sleep30-21swapper/322:07:283
5811762132,7sleep30-21swapper/320:07:353
8385722123,5sleep30-21swapper/300:27:313
8211662122,6sleep30-21swapper/300:12:303
8162502122,6sleep30-21swapper/300:07:253
8101642122,6sleep30-21swapper/323:57:383
8018622122,6sleep30-21swapper/323:52:283
7886912123,5sleep30-21swapper/323:37:323
7549412122,6sleep30-21swapper/323:02:343
7408182122,5sleep30-21swapper/322:50:013
7399092122,6sleep30-21swapper/322:47:323
7317652122,6sleep30-21swapper/322:42:273
7264982122,6sleep30-21swapper/322:37:253
7219442122,6sleep30-21swapper/322:32:283
7068672122,6sleep30-21swapper/322:17:273
7010242122,6sleep30-21swapper/322:10:013
6956882122,6sleep30-21swapper/322:02:443
6761092122,6sleep30-21swapper/321:45:023
6707032122,6sleep30-21swapper/321:37:433
6612742122,6sleep30-21swapper/321:30:003
6520832122,6sleep30-21swapper/321:22:263
6520832122,6sleep30-21swapper/321:22:263
6468302122,6sleep30-21swapper/321:17:003
6422672122,6sleep30-21swapper/321:12:273
6217412122,6sleep30-21swapper/320:50:003
6115722121,6sleep30-21swapper/320:40:013
6021202122,6sleep30-21swapper/320:32:233
5574222122,6sleep30-21swapper/319:47:253
5423022123,6sleep30-21swapper/319:32:243
5411832123,5sleep30-21swapper/319:27:393
5351062120,2sleep3584-21kworker/3:2+events19:22:323
5209282122,6sleep30-21swapper/319:12:303
8497702112,5sleep30-21swapper/300:37:343
8414262112,5sleep30-21swapper/300:32:253
8414262112,5sleep30-21swapper/300:32:253
8308252112,5sleep30-21swapper/300:20:013
7914152112,5sleep30-21swapper/323:41:253
7852062112,5sleep30-21swapper/323:32:343
7770532112,6sleep30-21swapper/323:27:293
7716842112,6sleep30-21swapper/323:22:233
7704412112,5sleep30-21swapper/323:17:353
7613202112,6sleep30-21swapper/323:10:153
7462642112,6sleep30-21swapper/322:55:353
7120272112,5sleep30-21swapper/322:22:293
7120272112,5sleep30-21swapper/322:22:293
6720132112,5sleep30-21swapper/321:42:283
6576822112,5sleep30-21swapper/321:27:363
6274632112,6sleep30-21swapper/320:57:263
6221822112,5sleep30-21swapper/320:52:213
6120072112,5sleep30-21swapper/320:42:223
5921222112,6sleep30-21swapper/320:21:233
5869952112,5sleep30-21swapper/320:15:013
5866802112,5sleep30-21swapper/320:12:533
5723752112,6sleep30-21swapper/320:01:533
5673362112,5sleep30-21swapper/319:57:243
5520962112,5sleep30-21swapper/319:41:113
5502462112,5sleep30-21swapper/319:37:343
5254052112,5sleep30-21swapper/319:15:033
8110822102,5sleep30-21swapper/300:00:033
6368122102,5sleep30-21swapper/321:05:093
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional