You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-22 - 00:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot3s.osadl.org (updated Tue Jul 21, 2026 12:44:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
132792228158,57sleep30-21swapper/307:07:053
127352223192,21sleep20-21swapper/207:05:262
134612203164,26sleep10-21swapper/107:09:231
133032203164,26sleep00-21swapper/007:07:210
2141921530,4sleep21360899cyclictest11:05:182
136089910399,3cyclictest0-21swapper/211:38:212
13608999288,3cyclictest0-21swapper/211:56:302
13608995750,5cyclictest0-21swapper/208:15:002
72532500,2sleep10-21swapper/109:20:131
184882490,2sleep00-21swapper/009:45:170
13608994137,3cyclictest0-21swapper/208:55:222
1360899390,29cyclictest0-21swapper/212:26:092
13608993725,3cyclictest0-21swapper/210:01:292
13608993723,3cyclictest0-21swapper/210:57:582
1360899361,20cyclictest0-21swapper/208:02:532
1360899361,15cyclictest0-21swapper/209:19:092
13608993525,3cyclictest0-21swapper/209:57:292
1360899351,23cyclictest0-21swapper/208:33:332
1360899351,21cyclictest0-21swapper/211:53:412
1360899341,14cyclictest0-21swapper/207:13:532
1360899331,22cyclictest0-21swapper/209:28:012
1360899331,13cyclictest0-21swapper/210:16:372
1360899330,16cyclictest0-21swapper/211:18:022
1360299331,23cyclictest0-21swapper/108:58:231
1360299331,19cyclictest0-21swapper/108:08:111
1359799337,12cyclictest4520-21perf09:15:010
1359799337,12cyclictest4520-21perf09:15:010
1359799333,14cyclictest20522-21munin-run11:05:010
251032320,2sleep30-21swapper/311:15:013
13608993221,3cyclictest0-21swapper/211:43:372
1360899321,19cyclictest0-21swapper/209:30:292
1360899321,16cyclictest0-21swapper/212:39:532
1360899321,13cyclictest0-21swapper/211:23:292
1360899320,19cyclictest0-21swapper/211:34:292
1360299321,24cyclictest0-21swapper/107:29:111
1360299320,12cyclictest0-21swapper/108:50:071
13608993116,4cyclictest9156-21taskset10:35:372
1360899311,3cyclictest0-21swapper/212:09:092
1360899311,20cyclictest0-21swapper/208:22:412
1360899311,19cyclictest0-21swapper/210:33:332
1360899311,14cyclictest0-21swapper/210:25:092
1360899311,14cyclictest0-21swapper/209:39:292
1360899311,13cyclictest0-21swapper/207:50:572
1360899311,12cyclictest0-21swapper/211:00:262
1360899311,12cyclictest0-21swapper/208:07:492
1359799313,13cyclictest24911-21munin-run11:15:000
1360899309,13cyclictest0-21swapper/211:27:492
1360899301,16cyclictest0-21swapper/209:41:252
1360899301,14cyclictest0-21swapper/211:48:132
1360899301,14cyclictest0-21swapper/210:47:182
1360899301,14cyclictest0-21swapper/209:01:302
1360899301,14cyclictest0-21swapper/208:49:502
1360899301,13cyclictest0-21swapper/212:21:332
1360899301,13cyclictest0-21swapper/208:51:342
1360899301,11cyclictest7606-21smartctl09:20:172
1360899300,18cyclictest0-21swapper/210:52:342
1360299300,23cyclictest0-21swapper/108:00:311
1360299300,11cyclictest0-21swapper/110:00:271
1360899291,20cyclictest0-21swapper/210:42:372
1360899291,19cyclictest0-21swapper/210:24:092
1360899291,19cyclictest0-21swapper/210:24:092
1360899291,18cyclictest0-21swapper/207:33:572
1360899291,13cyclictest0-21swapper/207:19:572
1360899291,12cyclictest0-21swapper/211:13:462
1360899291,12cyclictest0-21swapper/210:10:172
1360899291,12cyclictest0-21swapper/208:37:572
1360899291,12cyclictest0-21swapper/207:28:502
1360299299,7cyclictest0-21swapper/107:20:111
1360299290,6cyclictest0-21swapper/111:17:551
1360299290,13cyclictest0-21swapper/110:40:241
1360299290,11cyclictest0-21swapper/110:32:161
13597992910,16cyclictest13912-21munin-run10:50:010
78362280,3sleep31361499cyclictest09:20:203
201022280,4sleep230-21rcuc/207:20:242
13608992815,7cyclictest0-21swapper/212:32:492
1360899281,19cyclictest0-21swapper/207:59:412
1360899281,14cyclictest0-21swapper/209:52:532
1360899281,13cyclictest0-21swapper/209:14:102
1360899281,13cyclictest0-21swapper/209:14:102
1360899281,12cyclictest12816-21cstates12:00:132
1360899281,12cyclictest0-21swapper/212:15:372
1360899281,12cyclictest0-21swapper/212:13:452
1360899281,11cyclictest0-21swapper/207:47:252
1360299281,12cyclictest0-21swapper/112:27:511
1360299281,11cyclictest0-21swapper/111:48:351
1360299281,11cyclictest0-21swapper/107:31:031
1360299281,10cyclictest986-21hddtemp_smartct09:05:151
1360299280,17cyclictest0-21swapper/110:39:361
1360299280,10cyclictest23-21ksoftirqd/112:06:011
1359799281,14cyclictest23681-21basename08:45:010
13608992715,3cyclictest0-21swapper/208:40:382
1360899271,12cyclictest0-21swapper/209:45:052
1360899271,11cyclictest0-21swapper/210:06:492
1360299271,9cyclictest0-21swapper/111:44:111
1360299271,9cyclictest0-21swapper/111:01:391
1360299271,16cyclictest0-21swapper/112:16:071
1360299271,12cyclictest0-21swapper/108:17:561
1360299271,11cyclictest0-21swapper/109:58:551
1360299271,11cyclictest0-21swapper/109:36:551
1360299271,10cyclictest0-21swapper/111:54:151
1360299271,10cyclictest0-21swapper/108:47:521
1360299271,10cyclictest0-21swapper/108:33:081
1360299271,10cyclictest0-21swapper/107:54:511
1360299270,5cyclictest0-21swapper/110:57:401
1360299270,12cyclictest0-21swapper/111:20:311
1360299270,11cyclictest0-21swapper/112:38:321
1360299270,11cyclictest0-21swapper/110:13:271
1359799272,10cyclictest0-21swapper/010:03:230
58702260,4sleep05875-21fschecks_time10:30:150
1360899261,9cyclictest0-21swapper/209:09:022
1360899261,12cyclictest0-21swapper/208:19:452
1360299261,9cyclictest0-21swapper/110:27:401
1360299261,9cyclictest0-21swapper/107:19:281
1360299261,16cyclictest0-21swapper/108:41:041
1360299261,12cyclictest0-21swapper/107:40:271
1360299261,11cyclictest0-21swapper/112:33:081
1360299261,11cyclictest0-21swapper/110:51:481
1360299261,11cyclictest0-21swapper/109:53:231
1360299261,10cyclictest0-21swapper/111:56:351
1360299261,10cyclictest0-21swapper/107:45:071
1360299260,9cyclictest0-21swapper/110:16:511
1360299260,5cyclictest0-21swapper/110:46:281
1360299260,10cyclictest0-21swapper/111:27:111
1360899251,13cyclictest0-21swapper/208:27:292
1360299259,3cyclictest0-21swapper/108:35:161
1360299251,9cyclictest0-21swapper/111:13:471
1360299251,9cyclictest0-21swapper/109:48:031
1360299251,8cyclictest0-21swapper/112:02:111
1360299251,11cyclictest0-21swapper/107:37:211
1360299251,10cyclictest0-21swapper/109:00:591
1360299250,9cyclictest0-21swapper/108:20:321
1360299250,9cyclictest0-21swapper/107:14:151
1360299250,11cyclictest0-21swapper/111:35:311
1360299250,11cyclictest0-21swapper/111:32:511
81292240,4sleep011-21rcuc/011:50:010
13614992413,3cyclictest12050irq/123-ahci[0011:45:023
13614992411,2cyclictest636-21perf10:20:013
1361499241,12cyclictest26719-21/usr/sbin/munin10:05:213
1360899241,12cyclictest0-21swapper/207:37:012
1360899240,12cyclictest0-21swapper/207:41:092
1360299241,10cyclictest0-21swapper/109:33:111
1360299240,9cyclictest0-21swapper/109:12:551
1360299240,9cyclictest0-21swapper/109:12:551
1360299240,10cyclictest0-21swapper/110:05:071
1360299240,10cyclictest0-21swapper/109:15:391
1359799247,14cyclictest23346-21perf12:25:010
1359799243,18cyclictest24224-21tail12:25:170
1361499238,3cyclictest0-21swapper/312:26:173
1360299231,10cyclictest0-21swapper/111:08:451
1360299231,10cyclictest0-21swapper/110:21:441
1360299231,10cyclictest0-21swapper/110:21:431
1360299231,10cyclictest0-21swapper/109:44:471
1360299231,10cyclictest0-21swapper/109:27:211
1360299230,9cyclictest0-21swapper/108:14:361
1360299230,8cyclictest0-21swapper/107:59:111
1361499223,11cyclictest28915-21/usr/sbin/munin10:10:263
1361499222,3cyclictest17533-21latency07:15:193
1360299221,10cyclictest0-21swapper/112:20:431
1360299221,10cyclictest0-21swapper/112:10:591
1360299221,10cyclictest0-21swapper/108:27:381
1359799225,6cyclictest0-21swapper/011:33:200
121762220,2sleep339-21rcuc/309:30:193
1361499211,5cyclictest0-21swapper/310:54:083
13614992114,4cyclictest14449-21gltestperf07:10:163
1361499211,13cyclictest0-21swapper/311:16:163
1359799215,6cyclictest0-21swapper/011:25:480
1359799212,11cyclictest9124-21/usr/sbin/munin09:25:120
13597992116,3cyclictest1806-21grep09:05:240
1359799211,5cyclictest0-21swapper/012:12:200
1359799210,10cyclictest0-21swapper/009:17:460
1361499209,3cyclictest20114-21/usr/sbin/munin09:50:233
1361499202,4cyclictest3048-21sed11:35:273
1361499201,8cyclictest0-21swapper/312:36:243
1361499201,5cyclictest0-21swapper/311:04:113
13614992011,2cyclictest87650irq/129-enp1s0-07:40:193
1361499201,12cyclictest0-21swapper/311:30:023
1361499201,11cyclictest0-21swapper/309:45:123
1359799209,3cyclictest19767-21grep12:15:170
1359799208,3cyclictest0-21swapper/009:03:350
1359799204,9cyclictest0-21swapper/010:26:450
1359799202,10cyclictest25136-21/usr/sbin/munin11:15:150
13597992013,4cyclictest8900-21dump-pmu-power09:25:010
1359799201,13cyclictest0-21swapper/012:30:290
1359799201,11cyclictest26088-21/usr/sbin/munin08:50:210
1359799201,10cyclictest7636-21cut10:35:120
1359799201,10cyclictest24788-21grep07:30:270
1359799200,5cyclictest0-21swapper/009:44:120
110662200,1sleep00-21swapper/008:15:160
1361499198,3cyclictest87650irq/129-enp1s0-08:35:233
1361499198,3cyclictest5342-21/usr/sbin/munin10:30:163
1361499197,5cyclictest401ktimersoftd/308:20:193
1361499197,5cyclictest401ktimersoftd/308:05:253
1361499192,15cyclictest0-21swapper/312:16:423
1361499192,14cyclictest21803-21grep08:40:133
1361499192,14cyclictest1308-21cut09:05:183
13614991915,3cyclictest39-21rcuc/312:10:273
1361499191,10cyclictest808-21snmpd09:04:383
1361499191,10cyclictest4105-21/usr/sbin/munin08:00:243
1359799199,3cyclictest25474-21/usr/sbin/munin07:35:150
1359799198,4cyclictest0-21swapper/009:32:140
1359799198,3cyclictest808-21snmpd08:37:300
1359799197,3cyclictest0-21swapper/010:07:490
1359799195,4cyclictest0-21swapper/012:08:210
1359799195,4cyclictest0-21swapper/009:55:410
1359799193,3cyclictest0-21swapper/011:52:260
1359799191,8cyclictest0-21swapper/011:41:480
1359799191,15cyclictest30862-21grep07:45:200
1359799191,10cyclictest808-21snmpd07:22:160
1359799191,10cyclictest0-21swapper/012:03:330
1359799191,10cyclictest0-21swapper/011:08:580
1359799191,10cyclictest0-21swapper/010:15:160
117762191,3sleep311819-21cut08:15:233
312222180,2sleep30-21swapper/311:26:393
1361499187,3cyclictest87650irq/129-enp1s0-09:25:213
1361499187,3cyclictest21082-21/usr/sbin/munin07:25:213
1361499186,5cyclictest39-21rcuc/312:00:113
1361499184,6cyclictest755-21rngd11:45:413
1361499184,3cyclictest39-21rcuc/311:20:193
1361499181,8cyclictest0-21swapper/312:31:573
1361499181,7cyclictest5320-21grep09:15:183
1361499181,6cyclictest0-21swapper/311:50:393
13614991812,4cyclictest579-21systemd-journal10:41:193
1361499181,10cyclictest0-21swapper/311:05:103
1361499180,9cyclictest27004-21memory08:50:193
1359799188,3cyclictest15633-21unixbench_multi10:50:250
1359799185,3cyclictest0-21swapper/012:36:540
1359799183,12cyclictest27671-21/usr/sbin/munin07:40:150
1359799182,13cyclictest2301-21diskmemload11:35:180
1359799181,9cyclictest8507-21/usr/sbin/munin08:10:200
1359799181,9cyclictest29134-21kernelversion08:55:190
1359799181,9cyclictest0-21swapper/007:14:340
1359799181,6cyclictest0-21swapper/011:57:260
1359799181,6cyclictest0-21swapper/008:45:170
1359799181,13cyclictest22074-21grep07:25:210
1359799181,11cyclictest0-21swapper/010:43:130
1359799180,8cyclictest0-21swapper/010:23:280
1359799180,8cyclictest0-21swapper/010:23:280
1361499174,3cyclictest41-21ksoftirqd/310:55:043
1361499174,3cyclictest17874-21sort09:45:033
1361499173,7cyclictest0-21swapper/310:21:533
1361499173,7cyclictest0-21swapper/310:21:533
1361499173,6cyclictest0-21swapper/310:47:583
1361499172,6cyclictest87650irq/129-enp1s0-07:35:273
1361499172,5cyclictest0-21swapper/312:25:013
1361499172,12cyclictest7538-21/usr/sbin/munin10:35:153
1361499171,6cyclictest0-21swapper/311:55:513
1361499171,4cyclictest15107-21/usr/sbin/munin08:25:213
1361499171,3cyclictest0-21swapper/309:11:553
1361499171,3cyclictest0-21swapper/309:11:553
13614991713,2cyclictest827-21runrttasks10:00:133
13614991712,3cyclictest30237-21grep07:45:163
13614991712,3cyclictest23286-21acpi07:30:143
1361499171,15cyclictest0-21swapper/309:38:203
1361499171,14cyclictest0-21swapper/307:50:403
13614991711,3cyclictest23893-21/usr/sbin/munin08:45:263
13614991711,3cyclictest23653-21threads09:55:273
13614991711,3cyclictest19119-21cat07:20:133
1361499171,10cyclictest39-21rcuc/308:10:203
1361499171,10cyclictest0-21swapper/310:27:513
1359799173,3cyclictest87550irq/128-enp1s0-08:32:180
1359799171,6cyclictest0-21swapper/010:56:190
1359799171,15cyclictest0-21swapper/008:22:560
1359799171,10cyclictest0-21swapper/011:20:320
1359799171,10cyclictest0-21swapper/010:13:450
13597991710,4cyclictest16466-21munin-node07:15:040
1361499168,1cyclictest0-21swapper/307:55:153
1361499161,6cyclictest0-21swapper/312:05:103
13614991612,2cyclictest29954-21sshd08:56:183
1361499160,14cyclictest0-21swapper/308:30:263
1359799162,8cyclictest0-21swapper/009:35:020
1359799161,6cyclictest4105-21/usr/sbin/munin08:00:140
1359799161,2cyclictest0-21swapper/008:25:190
13597991612,3cyclictest0-21swapper/009:50:030
13597991611,3cyclictest808-21snmpd07:52:230
13597991611,3cyclictest7554-21sendmail_mailst08:05:260
1359799161,12cyclictest3410-21unixbench_multi07:55:280
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional