You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-11 - 04:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot3s.osadl.org (updated Sat Jul 11, 2026 00:44:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
97742238165,60sleep20-21swapper/219:09:592
96882236161,24sleep00-21swapper/019:08:520
96992234163,57sleep10-21swapper/119:09:011
94682232158,26sleep30-21swapper/319:06:033
66012530,4sleep341-21ksoftirqd/322:40:173
175142520,2sleep121-21rcuc/123:05:151
78942500,2sleep00-21swapper/020:15:180
128372500,1sleep20-21swapper/219:15:052
9868994239,2cyclictest0-21swapper/219:52:082
986899380,28cyclictest0-21swapper/200:10:122
985699378,14cyclictest24019-21munin-run00:35:010
985699378,13cyclictest22775-21basename22:05:010
9868993633,2cyclictest0-21swapper/223:16:172
9856993612,7cyclictest16771-21kworker/u8:223:17:250
986899341,23cyclictest0-21swapper/200:07:282
986499341,6cyclictest0-21swapper/122:17:541
986499341,6cyclictest0-21swapper/122:17:541
986899331,19cyclictest0-21swapper/223:30:212
986899321,23cyclictest0-21swapper/221:40:132
986899311,24cyclictest0-21swapper/223:05:162
986899311,18cyclictest0-21swapper/219:31:412
986899310,17cyclictest0-21swapper/221:21:332
986899301,9cyclictest0-21swapper/219:24:012
986899301,10cyclictest0-21swapper/220:34:442
986899300,23cyclictest0-21swapper/220:47:442
986899300,10cyclictest0-21swapper/222:26:562
986499301,12cyclictest25154-21memory00:35:191
986499301,12cyclictest0-21swapper/122:28:501
985699303,12cyclictest24344-21idleruntime-cro20:55:010
986899291,9cyclictest0-21swapper/219:29:572
986899291,9cyclictest0-21swapper/200:16:322
986899291,10cyclictest0-21swapper/220:51:442
986899290,27cyclictest0-21swapper/219:45:292
986899290,13cyclictest0-21swapper/220:09:282
986499291,12cyclictest0-21swapper/121:03:271
986499291,12cyclictest0-21swapper/119:36:261
986499291,12cyclictest0-21swapper/100:13:101
986899281,9cyclictest0-21swapper/221:31:172
986899281,2cyclictest0-21swapper/221:53:452
986899281,13cyclictest0-21swapper/221:38:292
986899281,10cyclictest0-21swapper/223:57:322
986899280,16cyclictest0-21swapper/222:16:002
986899280,16cyclictest0-21swapper/222:16:002
986499281,9cyclictest0-21swapper/121:58:141
986499281,11cyclictest0-21swapper/123:42:501
986499281,10cyclictest0-21swapper/123:12:111
986499281,10cyclictest0-21swapper/123:04:511
986499281,10cyclictest0-21swapper/122:54:151
986499281,10cyclictest0-21swapper/100:25:591
986499280,12cyclictest0-21swapper/121:35:181
985699281,13cyclictest24959-21munin-run22:10:010
83042280,3sleep18309-21cpuspeed_turbos22:45:121
986899271,8cyclictest0-21swapper/222:07:082
986899271,12cyclictest0-21swapper/222:39:162
986899271,12cyclictest0-21swapper/221:02:372
986899271,11cyclictest0-21swapper/221:16:252
986899271,11cyclictest0-21swapper/220:21:122
986899271,11cyclictest0-21swapper/220:02:442
986899271,10cyclictest0-21swapper/220:38:282
986899271,10cyclictest0-21swapper/200:04:322
986899270,19cyclictest0-21swapper/222:04:482
986899270,16cyclictest0-21swapper/221:45:132
986899270,12cyclictest0-21swapper/222:42:042
986899270,12cyclictest0-21swapper/200:34:282
986899270,11cyclictest0-21swapper/220:42:042
986499271,10cyclictest0-21swapper/100:18:301
986899261,9cyclictest0-21swapper/219:43:292
986899261,12cyclictest0-21swapper/222:51:002
986899261,11cyclictest0-21swapper/222:11:322
986899261,11cyclictest0-21swapper/200:20:282
986899261,10cyclictest0-21swapper/223:39:332
986899260,8cyclictest0-21swapper/220:57:172
986899260,18cyclictest0-21swapper/219:35:332
986899260,16cyclictest0-21swapper/222:23:402
986899260,11cyclictest0-21swapper/222:49:122
986499266,4cyclictest0-21swapper/121:42:261
986499261,9cyclictest0-21swapper/122:39:541
986499261,9cyclictest0-21swapper/121:28:301
986499261,17cyclictest0-21swapper/119:25:541
986499261,12cyclictest0-21swapper/120:45:471
986499261,10cyclictest0-21swapper/123:17:591
986499261,10cyclictest0-21swapper/121:11:351
985699261,13cyclictest16786-21munin-run23:05:010
987499251,7cyclictest19257-21hddtemp_smartct21:55:163
986899251,9cyclictest0-21swapper/220:17:082
986899251,11cyclictest0-21swapper/223:46:072
986899251,11cyclictest0-21swapper/223:12:202
986899250,12cyclictest0-21swapper/221:08:412
986899250,12cyclictest0-21swapper/221:08:412
986499256,3cyclictest0-21swapper/122:31:061
986499251,9cyclictest0-21swapper/122:01:381
986499251,9cyclictest0-21swapper/119:51:261
986499251,9cyclictest0-21swapper/119:47:501
986499251,16cyclictest0-21swapper/120:18:031
986499251,11cyclictest0-21swapper/123:56:181
986499251,11cyclictest0-21swapper/120:28:231
985699256,16cyclictest2973-21munin-run21:20:010
985699251,12cyclictest13354-21awk20:30:020
163392250,4sleep121-21rcuc/121:50:011
987499244,15cyclictest8553-40dnf20:15:283
987499241,11cyclictest9792-21users22:45:263
986899245,3cyclictest0-21swapper/223:23:212
986899241,8cyclictest0-21swapper/200:39:322
986899241,11cyclictest0-21swapper/222:32:562
986899240,6cyclictest31299-21kworker/u8:023:00:212
986899240,11cyclictest0-21swapper/222:56:162
986499249,4cyclictest0-21swapper/119:20:151
986499243,4cyclictest0-21swapper/119:31:341
986499241,9cyclictest32174-21perf23:40:011
986499241,9cyclictest0-21swapper/121:31:141
986499241,15cyclictest0-21swapper/123:54:461
986499241,14cyclictest0-21swapper/120:05:261
986499241,13cyclictest0-21swapper/121:05:031
986499241,13cyclictest0-21swapper/121:05:031
986499240,8cyclictest0-21swapper/121:51:181
985699248,14cyclictest21527-21awk19:35:000
258202240,2sleep20-21swapper/223:25:112
258202240,2sleep20-21swapper/223:25:112
987499231,16cyclictest0-21swapper/322:51:053
986899231,9cyclictest0-21swapper/221:13:192
986899230,9cyclictest0-21swapper/220:14:002
986899230,17cyclictest0-21swapper/220:26:002
986899230,10cyclictest0-21swapper/221:27:572
986499234,11cyclictest0-21swapper/119:10:181
986499232,15cyclictest87650irq/129-enp1s0-00:32:501
986499231,9cyclictest0-21swapper/122:20:141
986499231,9cyclictest0-21swapper/122:11:261
986499231,14cyclictest0-21swapper/100:07:221
986499231,12cyclictest0-21swapper/120:24:591
986499230,9cyclictest0-21swapper/122:05:341
9874992216,4cyclictest30227-21sed22:20:163
986899226,7cyclictest0-21swapper/221:56:562
986899225,3cyclictest0-21swapper/219:14:122
986899221,5cyclictest0-21swapper/223:50:202
986899220,9cyclictest0-21swapper/223:42:472
986499228,3cyclictest0-21swapper/119:40:301
986499221,9cyclictest0-21swapper/120:03:581
986499221,15cyclictest25544-21strings20:55:191
986499221,11cyclictest0-21swapper/120:44:391
986499221,10cyclictest0-21swapper/122:56:351
986499221,10cyclictest0-21swapper/120:52:571
986499221,10cyclictest0-21swapper/119:57:181
986499221,10cyclictest0-21swapper/119:57:181
986499221,10cyclictest0-21swapper/119:17:291
986499220,16cyclictest0-21swapper/120:34:451
985699227,14cyclictest0-21swapper/021:15:000
985699224,15cyclictest25923-21awk19:45:000
985699222,11cyclictest15765-21/usr/sbin/munin20:35:170
985699221,14cyclictest0-21swapper/000:22:060
987499211,12cyclictest0-21swapper/321:42:373
9874992110,3cyclictest32669-21unixbench_multi21:10:243
986899211,10cyclictest32117-21users19:55:262
986899211,10cyclictest32117-21users19:55:262
986899210,9cyclictest0-21swapper/200:26:042
986499219,11cyclictest23-21ksoftirqd/120:35:071
986499217,3cyclictest0-21swapper/123:20:231
986499216,3cyclictest0-21swapper/120:12:261
986499215,8cyclictest0-21swapper/121:24:141
986499211,8cyclictest3093-21cat21:20:021
9864992113,3cyclictest0-21swapper/100:02:341
986499211,15cyclictest0-21swapper/123:34:491
986499211,15cyclictest0-21swapper/122:40:061
985699215,6cyclictest0-21swapper/023:30:210
985699212,11cyclictest9788-21/usr/sbin/munin21:35:140
985699212,11cyclictest2231-21/usr/sbin/munin23:45:220
985699211,6cyclictest0-21swapper/000:14:090
985699211,12cyclictest24241-21/usr/sbin/munin00:35:180
985699211,12cyclictest0-21swapper/022:25:100
985699211,11cyclictest26944-21head23:25:210
985699211,11cyclictest26944-21head23:25:210
985699210,11cyclictest0-21swapper/023:09:010
987499202,10cyclictest23936-21/usr/sbin/munin19:40:213
987499201,5cyclictest0-21swapper/323:36:123
987499201,10cyclictest0-21swapper/320:43:053
9864992013,3cyclictest0-21swapper/123:27:441
9864992013,3cyclictest0-21swapper/123:27:441
986499201,11cyclictest0-21swapper/123:45:301
985699202,10cyclictest30531-21/usr/sbin/munin19:55:220
985699202,10cyclictest30531-21/usr/sbin/munin19:55:220
985699201,4cyclictest0-21swapper/022:46:450
985699201,12cyclictest0-21swapper/021:50:470
985699201,11cyclictest30192-21/usr/sbin/munin23:35:170
985699201,11cyclictest27378-21/usr/sbin/munin22:15:190
985699201,11cyclictest27378-21/usr/sbin/munin22:15:190
985699201,11cyclictest0-21swapper/021:59:280
987499198,3cyclictest6626-21/usr/sbin/munin23:55:173
987499198,3cyclictest23607-21/usr/sbin/munin23:20:223
987499191,9cyclictest0-21swapper/319:52:373
9874991915,2cyclictest41-21ksoftirqd/319:15:013
9874991913,4cyclictest1418450/usr/sbin/munin21:45:243
987499191,2cyclictest0-21swapper/320:25:123
987499191,15cyclictest0-21swapper/321:30:273
987499191,10cyclictest808-21snmpd21:50:083
986499190,14cyclictest0-21swapper/100:23:321
985699197,3cyclictest0-21swapper/019:22:150
985699196,3cyclictest0-21swapper/000:27:060
985699195,5cyclictest0-21swapper/022:51:070
985699194,3cyclictest2286-21hddtemp_smartct22:30:160
985699191,6cyclictest0-21swapper/023:11:200
9856991911,5cyclictest11415-21cut00:05:150
985699191,10cyclictest29948-21strings21:05:190
985699191,10cyclictest29948-21strings21:05:190
985699191,10cyclictest28674-21sshd21:04:260
985699191,10cyclictest26138-21/usr/sbin/munin19:45:190
985699190,8cyclictest0-21swapper/000:17:440
254502190,2sleep00-21swapper/023:23:320
987499187,3cyclictest808-21snmpd00:31:263
987499185,4cyclictest4872-21chrt21:21:233
987499185,4cyclictest25049-21tune2fs20:55:143
987499184,3cyclictest0-21swapper/319:20:193
987499183,8cyclictest87350irq/126-enp1s0-22:00:163
987499182,7cyclictest0-21swapper/322:18:353
987499182,7cyclictest0-21swapper/322:18:353
987499182,4cyclictest32000-21sed19:55:263
987499182,4cyclictest32000-21sed19:55:263
987499182,3cyclictest0-21swapper/300:29:233
987499181,9cyclictest0-21swapper/323:43:063
987499181,8cyclictest20516-21sed19:30:213
987499181,7cyclictest5982-21grep21:25:173
987499181,7cyclictest0-21swapper/323:06:503
987499181,7cyclictest0-21swapper/322:33:413
987499181,5cyclictest0-21swapper/322:10:163
9874991813,3cyclictest31772-21/usr/sbin/munin22:25:093
9874991813,3cyclictest30920-21crond21:10:003
9874991813,3cyclictest30920-21crond21:10:003
9874991812,3cyclictest3642-21ntpq20:05:223
987499181,11cyclictest87350irq/126-enp1s0-21:00:113
987499181,11cyclictest0-21swapper/323:27:413
987499181,11cyclictest0-21swapper/323:27:403
987499181,10cyclictest808-21snmpd23:53:133
987499180,10cyclictest0-21swapper/319:45:233
985699186,3cyclictest808-21snmpd20:34:500
985699186,3cyclictest0-21swapper/021:30:240
985699185,5cyclictest3808-21/usr/sbin/munin22:35:250
985699185,3cyclictest0-21swapper/023:58:510
985699181,9cyclictest0-21swapper/023:40:130
9856991813,3cyclictest9695-21grep20:20:150
985699181,10cyclictest4774-21/usr/sbin/munin20:10:160
985699181,10cyclictest0-21swapper/000:00:210
51562181,2sleep00-21swapper/021:25:010
312142181,3sleep00-21swapper/022:20:530
269642180,2sleep00-21swapper/022:12:460
174102181,3sleep30-21swapper/300:19:593
152482180,2sleep00-21swapper/021:45:200
129692181,3sleep30-21swapper/300:09:273
987499175,3cyclictest41-21ksoftirqd/323:10:253
987499171,7cyclictest12605-21/usr/sbin/munin22:55:223
987499171,7cyclictest0-21swapper/320:20:213
987499171,6cyclictest41-21ksoftirqd/319:40:023
987499171,6cyclictest0-21swapper/321:15:143
987499171,6cyclictest0-21swapper/300:00:113
987499171,5cyclictest0-21swapper/322:35:543
9874991713,3cyclictest0-21swapper/300:24:213
9874991712,3cyclictest21406-21/usr/sbin/munin23:15:203
987499171,15cyclictest0-21swapper/320:03:563
987499171,10cyclictest0-21swapper/300:11:173
985699178,7cyclictest13133-21head21:40:210
985699177,2cyclictest17349-21/usr/sbin/munin19:25:120
985699176,3cyclictest87550irq/128-enp1s0-19:15:230
985699176,3cyclictest0-21swapper/023:51:320
985699171,9cyclictest0-21swapper/020:00:120
985699171,4cyclictest28332-21/usr/sbin/munin19:50:200
9856991712,3cyclictest21741-21/usr/sbin/munin19:35:200
9856991711,3cyclictest14113-21unixbench_multi22:55:260
985699171,10cyclictest0-21swapper/022:43:570
985699171,10cyclictest0-21swapper/021:20:400
41142170,2sleep30-21swapper/323:49:053
196162170,2sleep00-21swapper/020:41:040
987499165,5cyclictest0-21swapper/321:35:143
987499164,9cyclictest39-21rcuc/320:50:183
987499162,7cyclictest0-21swapper/322:05:063
987499162,11cyclictest28583-21grep23:30:153
987499161,9cyclictest0-21swapper/320:30:223
987499161,5cyclictest15151-21diskstats23:00:133
987499161,3cyclictest0-21swapper/319:25:153
9874991612,3cyclictest0-21swapper/320:48:353
9874991611,3cyclictest39-21rcuc/320:10:283
9874991611,3cyclictest25620-21cat00:35:243
987499160,9cyclictest0-21swapper/319:15:223
985699168,2cyclictest0-21swapper/019:10:190
985699161,3cyclictest0-21swapper/020:06:490
9856991610,4cyclictest20708-21cut20:45:160
9874991510,3cyclictest41-21ksoftirqd/320:40:013
9856991510,3cyclictest25324-21if_err_enp1s020:55:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional