You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-04 - 02:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot3s.osadl.org (updated Mon May 04, 2026 00:44:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
50092236159,26sleep00-21swapper/019:05:400
50212235163,24sleep20-21swapper/219:05:512
53402230161,56sleep30-21swapper/319:09:593
51372218147,58sleep10-21swapper/119:07:191
1931021820,4sleep3543799cyclictest23:20:123
1558421750,5sleep0541999cyclictest21:55:240
3029521730,4sleep1542799cyclictest20:05:021
5432991189,107cyclictest0-21swapper/221:21:332
5432997871,2cyclictest0-21swapper/221:05:572
250032650,4sleep011-21rcuc/023:30:240
97992590,4sleep07-21ksoftirqd/019:15:240
313442540,4sleep230-21rcuc/223:45:232
319382510,1sleep00-21swapper/021:20:170
232802500,3sleep121-21rcuc/122:15:121
57582490,1sleep00-21swapper/000:00:260
252952490,1sleep30-21swapper/321:05:193
218842480,1sleep00-21swapper/022:10:220
133022480,1sleep00-21swapper/000:20:120
314452430,1sleep00-21swapper/020:05:170
541999367,13cyclictest29318-21munin-run22:30:020
543299351,7cyclictest6800-21ps19:10:212
543799341,26cyclictest0-21swapper/322:24:513
543299341,25cyclictest0-21swapper/222:24:252
543799331,24cyclictest0-21swapper/320:25:553
543799331,23cyclictest0-21swapper/319:31:113
543299331,26cyclictest0-21swapper/221:14:332
543299331,14cyclictest0-21swapper/222:06:052
543299331,14cyclictest0-21swapper/220:25:012
541999337,12cyclictest6330-21kworker/0:222:57:570
541999331,23cyclictest11755-21timerandwakeup23:00:250
541999331,23cyclictest11755-21timerandwakeup23:00:250
543299321,25cyclictest0-21swapper/223:57:532
543299321,24cyclictest0-21swapper/219:31:212
543299321,19cyclictest0-21swapper/221:50:252
543299321,19cyclictest0-21swapper/221:50:252
543299321,17cyclictest0-21swapper/223:54:452
543299321,14cyclictest0-21swapper/200:32:492
543299321,13cyclictest0-21swapper/222:12:332
543299321,13cyclictest0-21swapper/221:45:332
543299321,12cyclictest0-21swapper/220:32:212
543299320,26cyclictest0-21swapper/200:16:052
543299320,14cyclictest0-21swapper/219:29:532
543299320,14cyclictest0-21swapper/219:29:532
543799310,24cyclictest0-21swapper/323:14:073
543299311,5cyclictest4744-21users21:30:272
543299311,17cyclictest0-21swapper/222:50:412
543299311,15cyclictest0-21swapper/223:19:412
543299311,14cyclictest0-21swapper/222:26:092
543299311,14cyclictest0-21swapper/221:41:332
543299311,14cyclictest0-21swapper/220:26:572
543299311,13cyclictest0-21swapper/220:55:282
543299311,13cyclictest0-21swapper/220:11:172
543299311,12cyclictest0-21swapper/219:45:052
543299311,12cyclictest0-21swapper/219:19:252
541999315,12cyclictest23070-21tr22:15:120
543799301,9cyclictest0-21swapper/320:17:273
543299301,19cyclictest0-21swapper/222:45:532
543299301,19cyclictest0-21swapper/200:21:132
543299301,14cyclictest0-21swapper/223:08:212
543299301,13cyclictest0-21swapper/222:59:532
543299301,13cyclictest0-21swapper/222:32:452
543299301,12cyclictest29667-21timerandwakeup20:00:252
543299301,12cyclictest0-21swapper/223:22:372
543299301,12cyclictest0-21swapper/222:40:452
543299301,12cyclictest0-21swapper/222:03:532
542799303,22cyclictest7157-40dnf22:50:261
541999307,11cyclictest0-21swapper/020:20:010
5437992912,3cyclictest24300-21crond21:05:013
543799291,12cyclictest0-21swapper/322:12:033
543799290,23cyclictest0-21swapper/323:16:593
543799290,22cyclictest0-21swapper/322:55:153
543299291,13cyclictest0-21swapper/223:36:452
543299291,13cyclictest0-21swapper/223:34:332
543299291,12cyclictest0-21swapper/223:01:562
543299291,12cyclictest0-21swapper/223:01:562
543299291,12cyclictest0-21swapper/221:59:532
543299291,12cyclictest0-21swapper/221:02:252
543299291,12cyclictest0-21swapper/200:13:332
543299291,12cyclictest0-21swapper/200:13:332
543299291,11cyclictest0-21swapper/220:47:012
543299291,11cyclictest0-21swapper/200:01:532
543299291,10cyclictest0-21swapper/219:52:052
543799281,11cyclictest0-21swapper/320:46:593
543799281,10cyclictest0-21swapper/323:36:313
543799280,12cyclictest0-21swapper/300:16:033
5432992817,3cyclictest0-21swapper/222:39:532
543299281,5cyclictest17388-21munin-run00:30:012
543299281,12cyclictest0-21swapper/223:12:292
543299281,12cyclictest0-21swapper/220:40:092
543299281,12cyclictest0-21swapper/220:06:492
543299281,11cyclictest0-21swapper/221:26:492
543299281,11cyclictest0-21swapper/219:42:012
543299281,11cyclictest0-21swapper/200:36:212
543299280,14cyclictest0-21swapper/221:16:372
542799282,17cyclictest7324-21dump-pmu-power21:40:011
5419992816,6cyclictest7157-40dnf22:50:260
5419992814,8cyclictest0-21swapper/000:35:260
188252280,4sleep339-21rcuc/320:50:183
543799271,12cyclictest0-21swapper/321:16:353
543799271,11cyclictest0-21swapper/320:56:473
543799271,11cyclictest0-21swapper/319:23:273
543799271,10cyclictest0-21swapper/320:24:473
543799270,22cyclictest0-21swapper/322:40:473
543799270,12cyclictest0-21swapper/323:59:553
543799270,11cyclictest0-21swapper/322:33:033
543299271,12cyclictest0-21swapper/222:19:012
543299271,10cyclictest0-21swapper/200:09:292
543299270,11cyclictest0-21swapper/220:39:212
543299270,11cyclictest0-21swapper/220:39:212
543799261,11cyclictest0-21swapper/320:11:353
543799261,11cyclictest0-21swapper/319:40:553
543799261,10cyclictest0-21swapper/319:45:033
543799260,12cyclictest0-21swapper/322:09:273
543799260,12cyclictest0-21swapper/321:12:313
543799260,12cyclictest0-21swapper/319:56:313
543799260,10cyclictest0-21swapper/321:53:433
543799260,10cyclictest0-21swapper/321:53:433
543299269,3cyclictest0-21swapper/223:28:452
543299261,12cyclictest0-21swapper/223:44:052
543299261,12cyclictest0-21swapper/219:35:412
543299261,10cyclictest0-21swapper/220:17:052
542799261,9cyclictest20455-21taskset22:09:111
5427992611,5cyclictest23598-40dnf19:49:141
543799255,3cyclictest0-21swapper/319:50:193
543799251,8cyclictest0-21swapper/320:40:273
543799251,10cyclictest0-21swapper/321:42:033
543799251,10cyclictest0-21swapper/320:06:353
543799250,13cyclictest0-21swapper/300:10:313
543799250,13cyclictest0-21swapper/300:10:313
543799250,11cyclictest0-21swapper/323:52:193
543799250,11cyclictest0-21swapper/319:12:193
543799250,10cyclictest0-21swapper/321:29:503
543799250,10cyclictest0-21swapper/300:30:473
542799251,17cyclictest0-21swapper/100:14:581
542799251,17cyclictest0-21swapper/100:14:581
541999257,4cyclictest21372-21/usr/sbin/munin23:25:240
293072251,2sleep329505-21unixbench_singl23:40:273
543799248,3cyclictest0-21swapper/323:32:343
543799243,5cyclictest7157-40dnf22:50:253
543799241,9cyclictest0-21swapper/321:49:473
543799241,9cyclictest0-21swapper/300:25:473
543799241,9cyclictest0-21swapper/300:05:473
543799241,11cyclictest0-21swapper/320:38:113
543799241,11cyclictest0-21swapper/320:38:113
543799241,10cyclictest0-21swapper/320:33:433
543799241,10cyclictest0-21swapper/319:35:393
543799240,11cyclictest0-21swapper/322:28:593
543799240,11cyclictest0-21swapper/321:33:193
543799240,11cyclictest0-21swapper/300:04:253
542799241,3cyclictest8513-21df22:55:121
5427992411,11cyclictest976-21kworker/u8:222:43:411
541999247,8cyclictest0-21swapper/021:30:190
541999242,14cyclictest16980-21/usr/sbin/munin23:15:280
543799239,2cyclictest0-21swapper/300:21:393
543799232,3cyclictest0-21swapper/322:45:193
543799231,11cyclictest0-21swapper/322:15:553
543799230,9cyclictest0-21swapper/320:03:353
543799230,10cyclictest0-21swapper/322:04:313
543299231,10cyclictest0-21swapper/221:36:332
5427992318,3cyclictest1969-21munin-run23:55:011
5427992316,4cyclictest28642-21hddtemp_smartct23:40:171
542799231,19cyclictest1-21systemd22:30:021
541999234,5cyclictest28695-21sh21:15:010
541999232,12cyclictest0-21swapper/023:44:450
541999231,4cyclictest0-21swapper/023:35:130
541999231,16cyclictest0-21swapper/000:25:020
541999231,10cyclictest0-21swapper/000:13:510
541999231,10cyclictest0-21swapper/000:13:510
543799226,3cyclictest0-21swapper/319:29:513
543799226,3cyclictest0-21swapper/319:29:513
543799221,9cyclictest0-21swapper/319:16:033
543799220,9cyclictest0-21swapper/323:01:393
543799220,9cyclictest0-21swapper/323:01:393
543799220,11cyclictest0-21swapper/321:24:343
543799220,10cyclictest0-21swapper/300:37:193
543299228,2cyclictest0-21swapper/219:55:212
542799226,14cyclictest9082-21kworker/u8:120:20:261
542799222,11cyclictest22216-21cat21:00:021
542799221,3cyclictest26939-21taskset22:22:491
5427992212,3cyclictest0-21swapper/100:05:241
542799221,18cyclictest9440-21memory19:15:191
542799220,15cyclictest87650irq/129-enp1s0-21:45:311
541999227,3cyclictest16700-21diskstats22:00:120
541999226,5cyclictest30885-21crond21:20:010
541999226,3cyclictest1576-21/usr/sbin/munin22:40:130
541999225,7cyclictest9757-21/usr/sbin/munin21:45:220
543799218,2cyclictest0-21swapper/321:36:313
543799217,2cyclictest0-21swapper/323:29:103
543799211,5cyclictest0-21swapper/323:47:463
543799210,10cyclictest0-21swapper/322:36:273
543299211,13cyclictest0-21swapper/219:23:012
5427992115,3cyclictest429-21expr20:10:121
5427992113,3cyclictest0-21swapper/123:45:161
5427992113,3cyclictest0-21swapper/123:27:181
5427992113,3cyclictest0-21swapper/123:09:021
5427992113,3cyclictest0-21swapper/122:49:181
542799211,18cyclictest0-21swapper/120:34:581
542799211,18cyclictest0-21swapper/100:18:081
542799211,15cyclictest0-21swapper/122:00:261
542799211,14cyclictest0-21swapper/121:19:311
541999217,6cyclictest0-21swapper/023:55:190
541999217,3cyclictest29784-21kworker/0:223:50:200
541999216,2cyclictest4738-21/usr/sbin/munin20:20:140
541999215,4cyclictest15847-21/usr/sbin/munin23:10:210
541999214,9cyclictest13168-21perl23:05:160
541999213,9cyclictest24534-21/usr/sbin/munin21:05:290
541999213,15cyclictest5779-21cut19:10:110
5419992112,2cyclictest0-21swapper/000:34:370
541999211,12cyclictest0-21swapper/020:25:160
541999210,15cyclictest31939-21runrttasks23:47:430
543799200,10cyclictest0-21swapper/321:58:013
543299201,14cyclictest0-21swapper/220:54:292
542799202,5cyclictest7919-1kworker/u9:000:34:581
542799202,2cyclictest87650irq/129-enp1s0-21:22:481
542799201,6cyclictest18608-21hddtemp_smartct20:50:161
5427992016,3cyclictest0-21swapper/119:59:341
542799201,2cyclictest14222-21switchtime19:25:241
542799201,2cyclictest14222-21switchtime19:25:241
5427992012,2cyclictest0-21swapper/123:00:051
5427992012,2cyclictest0-21swapper/123:00:051
542799201,14cyclictest0-21swapper/123:11:181
542799201,11cyclictest755-21rngd21:42:501
5427992010,3cyclictest0-21swapper/123:30:261
542799200,6cyclictest0-21swapper/100:29:361
542799200,3cyclictest0-21swapper/122:31:111
542799200,18cyclictest0-21swapper/122:35:051
542799200,15cyclictest0-21swapper/121:28:251
541999209,3cyclictest3777-21/usr/sbin/munin22:45:230
541999206,4cyclictest0-21swapper/022:20:120
541999204,2cyclictest23906-21/usr/sbin/munin19:50:160
541999203,14cyclictest7559-21/usr/sbin/munin21:40:200
541999203,14cyclictest20837-21sshd23:21:120
541999202,10cyclictest26100-21/usr/sbin/munin19:55:140
5419992012,5cyclictest13911-21needreboot19:25:190
5419992012,5cyclictest13911-21needreboot19:25:180
5419992011,5cyclictest7877-21smart_sda00:05:240
541999201,14cyclictest0-21swapper/021:25:120
541999201,11cyclictest28299-21/usr/sbin/munin20:00:250
541999200,7cyclictest10724-21/usr/sbin/munin19:20:190
543799191,9cyclictest0-21swapper/323:07:313
542799191,9cyclictest3564-21sed23:55:251
542799191,9cyclictest0-21swapper/121:35:011
5427991915,3cyclictest0-21swapper/121:10:551
5427991915,3cyclictest0-21swapper/121:06:391
5427991915,3cyclictest0-21swapper/119:22:461
5427991914,3cyclictest0-21swapper/120:15:121
542799191,2cyclictest7450-21taskset19:13:121
542799191,17cyclictest0-21swapper/123:22:341
542799191,17cyclictest0-21swapper/120:29:561
542799191,16cyclictest0-21swapper/121:00:041
542799191,16cyclictest0-21swapper/100:00:161
542799191,14cyclictest0-21swapper/123:36:171
542799191,14cyclictest0-21swapper/100:36:051
542799191,13cyclictest0-21swapper/100:23:151
541999198,3cyclictest31743-21/usr/sbin/munin22:35:170
541999198,3cyclictest11338-21/usr/sbin/munin20:35:190
541999198,3cyclictest11338-21/usr/sbin/munin20:35:190
541999194,11cyclictest13528-21/usr/sbin/munin20:40:130
541999191,12cyclictest0-21swapper/022:34:080
541999191,10cyclictest17931-21/usr/sbin/munin20:50:200
541999191,10cyclictest15116-21/usr/sbin/munin19:30:230
541999191,10cyclictest0-21swapper/000:15:380
542799182,13cyclictest15887-21tr20:45:131
5427991815,2cyclictest0-21swapper/121:51:221
5427991815,2cyclictest0-21swapper/121:51:221
5427991815,2cyclictest0-21swapper/119:51:191
5427991814,3cyclictest0-21swapper/120:07:231
5427991812,3cyclictest11677-21df_inode20:35:141
5427991812,3cyclictest11677-21df_inode20:35:131
542799181,16cyclictest0-21swapper/120:40:241
542799181,16cyclictest0-21swapper/119:40:101
542799181,16cyclictest0-21swapper/119:30:221
542799180,14cyclictest0-21swapper/123:16:271
541999182,7cyclictest87650irq/129-enp1s0-21:50:130
541999182,7cyclictest87650irq/129-enp1s0-21:50:120
541999182,14cyclictest5352-21sshd21:35:110
541999181,6cyclictest0-21swapper/022:05:170
541999181,4cyclictest21704-21/usr/sbin/munin19:45:160
541999181,11cyclictest0-21swapper/021:00:110
172982181,2sleep10-21swapper/119:35:051
5427991712,3cyclictest14455-21ls21:55:131
542799171,15cyclictest0-21swapper/122:10:041
541999177,7cyclictest1850-21unixbench_multi20:10:260
5419991712,3cyclictest21622-21unixbench_multi20:55:250
5419991710,4cyclictest19509-21/usr/sbin/munin19:40:200
541999161,5cyclictest0-21swapper/020:47:210
541999160,14cyclictest0-21swapper/020:30:070
541999153,2cyclictest17311-21/usr/sbin/munin19:35:230
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional