You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-26 - 16:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot3s.osadl.org (updated Sun Jul 26, 2026 12:44:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
11982235161,25sleep00-21swapper/007:06:520
14412231162,56sleep20-21swapper/207:09:592
14232231157,22sleep10-21swapper/107:09:461
14352203165,24sleep30-21swapper/307:09:573
1542999996,2cyclictest0-21swapper/210:35:312
1542998885,2cyclictest0-21swapper/209:08:342
1542997774,2cyclictest0-21swapper/212:00:552
74522540,4sleep0152799cyclictest08:35:130
223622530,1sleep30-21swapper/307:55:143
32592510,4sleep2154299cyclictest10:50:232
281582510,4sleep011-21rcuc/008:05:270
281582510,4sleep011-21rcuc/008:05:270
294582500,4sleep121-21rcuc/109:25:131
1542994845,2cyclictest0-21swapper/211:56:552
83372410,1sleep00-21swapper/009:50:130
1542994124,3cyclictest0-21swapper/212:33:522
1542993824,9cyclictest0-21swapper/212:05:452
154899371,25cyclictest0-21swapper/307:29:553
154299371,27cyclictest0-21swapper/211:25:242
1542993624,3cyclictest0-21swapper/212:18:242
154899350,27cyclictest0-21swapper/309:47:193
1542993523,3cyclictest0-21swapper/209:53:362
152799345,14cyclictest24830-21awk09:15:000
154899331,21cyclictest0-21swapper/312:26:473
154899330,27cyclictest0-21swapper/310:23:233
154899330,27cyclictest0-21swapper/310:23:223
1542993321,3cyclictest0-21swapper/211:12:372
154299331,12cyclictest24925-21cut09:15:012
152799339,11cyclictest19465-21idleruntime-cro11:30:010
152799338,12cyclictest13818-21munin-run08:50:020
152799336,12cyclictest32037-21idleruntime-cro10:45:020
1527993310,11cyclictest10677-21awk11:10:000
154899321,23cyclictest0-21swapper/310:17:433
1542993219,3cyclictest0-21swapper/210:19:082
1542993217,8cyclictest0-21swapper/210:31:532
1542993216,4cyclictest0-21swapper/210:24:482
1542993216,4cyclictest0-21swapper/210:24:482
154299321,16cyclictest0-21swapper/207:40:212
154899311,12cyclictest3415-21forks08:25:143
154899311,11cyclictest0-21swapper/311:45:173
154299311,14cyclictest0-21swapper/212:29:572
154299311,11cyclictest14438-21latency_hist10:05:002
40522300,5sleep0152799cyclictest07:15:010
1542993018,2cyclictest0-21swapper/211:45:132
154299301,20cyclictest0-21swapper/211:39:252
154299301,20cyclictest0-21swapper/211:05:012
154899291,19cyclictest0-21swapper/310:35:083
154899291,12cyclictest0-21swapper/312:33:053
154899291,12cyclictest0-21swapper/310:49:083
154899291,11cyclictest0-21swapper/309:11:153
154899291,10cyclictest0-21swapper/308:58:183
154899290,22cyclictest0-21swapper/309:44:433
1542992917,3cyclictest0-21swapper/211:33:132
154299291,19cyclictest25330-21/usr/sbin/munin08:00:182
154299291,19cyclictest0-21swapper/211:20:412
154299291,18cyclictest0-21swapper/209:42:172
154299291,13cyclictest0-21swapper/207:56:002
154299291,12cyclictest0-21swapper/210:56:012
154299291,12cyclictest0-21swapper/210:10:542
154299291,10cyclictest0-21swapper/208:30:212
154299291,10cyclictest0-21swapper/208:15:482
154299290,12cyclictest0-21swapper/209:55:122
152799291,13cyclictest28245-21munin-run11:50:010
154899281,13cyclictest0-21swapper/309:17:013
154899281,13cyclictest0-21swapper/309:17:013
154899281,10cyclictest2424-21unixbench_singl08:20:253
1542992816,3cyclictest0-21swapper/212:10:442
154299281,13cyclictest0-21swapper/210:42:132
154299281,13cyclictest0-21swapper/210:05:082
154299281,11cyclictest0-21swapper/208:35:292
154299280,12cyclictest11480-21sed12:25:012
152799282,9cyclictest29460-21kworker/0:110:35:450
162202270,4sleep011-21rcuc/010:05:260
1548992715,6cyclictest8080-21users11:00:283
154899270,17cyclictest0-21swapper/310:58:343
154299271,13cyclictest0-21swapper/209:27:372
154299271,12cyclictest0-21swapper/209:45:502
154299270,11cyclictest0-21swapper/209:35:452
153399272,13cyclictest29210-21munin-run09:25:001
1533992710,7cyclictest23487-21kworker/u8:011:50:371
152799278,16cyclictest17874-21munin-run12:40:010
154899261,9cyclictest0-21swapper/307:16:393
154899261,11cyclictest0-21swapper/307:30:593
154899261,11cyclictest0-21swapper/307:22:193
154899260,17cyclictest0-21swapper/310:07:033
154899260,10cyclictest0-21swapper/309:25:553
154899260,10cyclictest0-21swapper/307:41:593
154299267,3cyclictest0-21swapper/209:01:572
154299266,2cyclictest0-21swapper/211:40:372
154299261,15cyclictest0-21swapper/208:50:052
154299261,11cyclictest0-21swapper/211:53:052
154299261,10cyclictest0-21swapper/211:16:532
154299260,20cyclictest0-21swapper/209:24:412
152799262,8cyclictest30625-21kworker/0:008:50:470
152799261,9cyclictest17289-21kworker/0:107:49:110
152799261,13cyclictest21050-21idleruntime-cro10:20:010
154899251,8cyclictest0-21swapper/311:21:243
154899251,10cyclictest0-21swapper/312:16:553
154899251,10cyclictest0-21swapper/309:06:513
154899251,10cyclictest0-21swapper/308:16:273
154299258,4cyclictest0-21swapper/207:28:292
154299257,3cyclictest0-21swapper/207:19:492
154299254,3cyclictest0-21swapper/211:00:052
154299251,17cyclictest0-21swapper/210:25:292
154299251,13cyclictest0-21swapper/208:41:332
154299251,12cyclictest0-21swapper/209:15:332
154299251,12cyclictest0-21swapper/209:15:332
154299251,12cyclictest0-21swapper/208:11:262
1533992512,6cyclictest23618-21kworker/u8:009:11:591
153399251,19cyclictest0-21swapper/112:09:381
152799258,15cyclictest2501-21munin-run12:05:020
152799251,9cyclictest24116-21kworker/0:008:03:430
152799251,13cyclictest15071-21awk11:20:000
152799251,12cyclictest23239-21munin-run10:25:010
152799251,12cyclictest23239-21munin-run10:25:010
154899249,3cyclictest0-21swapper/307:39:233
154899241,9cyclictest17149-21sendmail_mailtr12:35:263
154899241,9cyclictest0-21swapper/308:11:013
154899240,10cyclictest0-21swapper/310:26:383
154899240,10cyclictest0-21swapper/309:21:593
154299245,3cyclictest0-21swapper/207:45:322
1542992411,7cyclictest0-21swapper/207:39:492
1542992411,3cyclictest0-21swapper/207:23:532
154299241,12cyclictest0-21swapper/210:47:492
1533992411,11cyclictest25779-21kworker/u8:211:49:261
1533992410,13cyclictest31224-21kworker/u8:009:37:311
153399240,17cyclictest0-21swapper/109:15:411
153399240,17cyclictest0-21swapper/109:15:411
128972240,4sleep0152799cyclictest11:15:000
210442231,2sleep321240-21sed11:30:263
154899233,11cyclictest10894-21/usr/sbin/munin11:10:183
154899231,9cyclictest0-21swapper/308:09:213
154899231,9cyclictest0-21swapper/308:09:213
154899231,11cyclictest0-21swapper/310:02:213
154899231,11cyclictest0-21swapper/308:35:163
154899230,9cyclictest0-21swapper/311:35:483
154299239,8cyclictest0-21swapper/209:31:412
154299237,3cyclictest0-21swapper/212:36:132
154299234,3cyclictest0-21swapper/208:58:332
154299231,11cyclictest0-21swapper/208:29:292
153399232,5cyclictest9272-21processes09:50:231
153399232,11cyclictest17254-21munin-run11:25:001
152799236,15cyclictest1235-21awk09:35:010
152799232,8cyclictest3716-21kworker/0:011:21:160
152799232,8cyclictest22377-21kworker/0:009:17:300
152799232,8cyclictest22377-21kworker/0:009:17:300
152799232,14cyclictest23185-21kworker/0:010:28:430
152799231,8cyclictest31308-21kworker/0:009:29:510
152799231,8cyclictest21416-21kworker/0:211:44:360
152799231,8cyclictest18598-21kworker/0:110:13:110
288802221,3sleep029149-21df08:10:130
154899228,7cyclictest0-21swapper/311:17:053
154899226,3cyclictest0-21swapper/308:49:463
154899221,9cyclictest0-21swapper/310:43:223
154899221,7cyclictest0-21swapper/309:04:433
154899221,13cyclictest0-21swapper/308:40:163
154899221,11cyclictest5984-21ntp_states12:10:213
154899221,10cyclictest0-21swapper/309:37:413
154899220,9cyclictest0-21swapper/311:26:553
154899220,8cyclictest0-21swapper/312:05:433
154299229,3cyclictest0-21swapper/208:20:162
154299221,11cyclictest0-21swapper/207:10:492
154299220,10cyclictest0-21swapper/208:46:012
153399228,12cyclictest22320-21kworker/u8:108:30:241
153399223,10cyclictest11741-21grep09:55:261
1533992214,3cyclictest0-21swapper/112:31:291
1533992214,3cyclictest0-21swapper/108:56:441
153399221,16cyclictest0-21swapper/111:07:111
153399221,15cyclictest0-21swapper/108:54:501
153399221,15cyclictest0-21swapper/108:14:211
153399221,15cyclictest0-21swapper/107:12:441
153399221,11cyclictest0-21swapper/109:46:051
152799229,2cyclictest13143-21kworker/0:012:32:490
152799228,8cyclictest30625-21kworker/0:008:30:250
152799227,3cyclictest20168-21kworker/0:309:07:460
152799222,9cyclictest28955-21kworker/0:309:22:240
152799222,8cyclictest10668-21kworker/0:108:40:570
152799222,19cyclictest17390-21kworker/0:207:59:110
152799222,11cyclictest9983-21hddtemp_smartct12:20:160
152799221,10cyclictest3716-21kworker/0:011:35:250
154899217,3cyclictest0-21swapper/311:50:333
154899216,3cyclictest0-21swapper/309:54:413
154899212,8cyclictest15110-21ntp_states08:50:203
154899211,8cyclictest0-21swapper/309:31:433
154899211,11cyclictest24416-21/usr/sbin/munin08:00:253
154899210,15cyclictest0-21swapper/311:59:273
154899210,11cyclictest0-21swapper/307:12:463
154299215,3cyclictest0-21swapper/207:32:002
1542992110,3cyclictest0-21swapper/207:51:442
153399218,3cyclictest9084-21munin-run12:20:011
153399213,10cyclictest6887-21cpu07:20:121
153399212,14cyclictest87350irq/126-enp1s0-10:13:511
153399212,10cyclictest0-21swapper/110:45:231
1533992117,3cyclictest0-21swapper/107:28:041
153399211,15cyclictest0-21swapper/111:00:221
153399211,14cyclictest0-21swapper/109:01:011
153399211,14cyclictest0-21swapper/108:05:051
153399211,14cyclictest0-21swapper/108:05:051
153399211,11cyclictest11275-21latency_hist12:25:011
153399210,16cyclictest0-21swapper/108:02:491
153399210,15cyclictest0-21swapper/108:36:261
153399210,15cyclictest0-21swapper/107:55:181
153399210,15cyclictest0-21swapper/107:50:221
153399210,15cyclictest0-21swapper/107:30:201
152799219,2cyclictest15727-21kworker/0:209:00:510
152799217,2cyclictest10701-21kworker/0:207:30:450
152799216,2cyclictest32354-21kworker/0:012:12:330
152799214,4cyclictest11805-21sshd09:55:260
152799212,9cyclictest3716-21kworker/0:011:32:290
152799211,9cyclictest16851-21kworker/0:107:22:360
152799211,8cyclictest30625-21kworker/0:008:28:050
152799211,8cyclictest20934-21kworker/0:310:30:410
1527992115,3cyclictest11019-21awk07:30:020
152799211,11cyclictest22613-21diskmemload11:55:170
152799211,11cyclictest11506-21/usr/sbin/munin12:25:140
152799211,11cyclictest0-21swapper/010:50:030
152799210,8cyclictest5291-21kworker/0:009:45:410
154899208,3cyclictest0-21swapper/310:14:373
154899205,3cyclictest0-21swapper/312:20:523
154899205,3cyclictest0-21swapper/307:50:413
154899204,6cyclictest0-21swapper/311:41:213
154899201,8cyclictest0-21swapper/312:00:573
154899201,10cyclictest0-21swapper/310:30:173
154899200,7cyclictest0-21swapper/309:59:113
154899200,10cyclictest0-21swapper/311:05:053
154299203,3cyclictest0-21swapper/208:06:522
154299203,3cyclictest0-21swapper/208:06:522
153399206,6cyclictest0-21swapper/111:44:211
153399204,14cyclictest5775-21sed10:55:281
153399204,10cyclictest0-21swapper/111:12:091
1533992016,3cyclictest0-21swapper/112:00:421
1533992016,3cyclictest0-21swapper/111:29:431
1533992016,3cyclictest0-21swapper/110:16:191
1533992013,4cyclictest2371-21grep08:20:251
1533992012,3cyclictest0-21swapper/110:35:251
1533992012,3cyclictest0-21swapper/109:05:551
153399201,17cyclictest13453-21strings10:00:211
153399201,17cyclictest0-21swapper/112:10:251
153399201,17cyclictest0-21swapper/111:35:461
153399201,17cyclictest0-21swapper/107:49:151
153399201,14cyclictest0-21swapper/112:35:031
153399201,14cyclictest0-21swapper/110:27:341
153399201,14cyclictest0-21swapper/108:29:211
153399201,14cyclictest0-21swapper/107:43:281
153399201,11cyclictest32456-21sed08:15:261
153399201,11cyclictest20051-21fschecks_count11:30:141
153399201,11cyclictest13689-21cstates07:35:131
1533992010,3cyclictest16694-21cat10:10:011
152799209,3cyclictest6488-21/usr/sbin/munin11:00:180
152799206,2cyclictest16851-21kworker/0:107:12:030
152799201,8cyclictest5291-21kworker/0:009:44:250
152799201,8cyclictest15727-21kworker/0:208:57:130
152799201,16cyclictest7114-21/usr/sbin/munin12:15:260
152799201,11cyclictest0-21swapper/010:04:500
154899196,3cyclictest0-21swapper/308:31:363
154899195,3cyclictest0-21swapper/307:45:533
153399192,16cyclictest0-21swapper/110:20:281
153399192,16cyclictest0-21swapper/110:20:281
1533991913,3cyclictest31743-21grep09:30:141
1533991912,2cyclictest0-21swapper/110:31:051
153399191,14cyclictest0-21swapper/112:27:321
153399191,14cyclictest0-21swapper/108:42:161
153399191,14cyclictest0-21swapper/107:17:291
153399191,10cyclictest30861-21expr11:55:111
153399190,17cyclictest0-21swapper/110:50:231
152799198,2cyclictest32648-21kworker/0:308:19:270
152799195,6cyclictest755-21rngd12:05:190
152799191,9cyclictest29460-21kworker/0:110:58:370
152799191,12cyclictest0-21swapper/010:45:150
138112191,2sleep10-21swapper/111:15:191
134192191,2sleep10-21swapper/108:45:261
154899183,3cyclictest0-21swapper/310:52:223
153399181,3cyclictest0-21swapper/110:40:101
153399181,16cyclictest0-21swapper/109:40:521
152799186,2cyclictest29411-21kworker/0:111:54:130
152799186,2cyclictest10754-21kworker/0:307:40:070
152799185,2cyclictest1440-21kworker/0:109:37:450
152799183,3cyclictest17289-21kworker/0:107:50:150
152799171,10cyclictest0-21swapper/008:20:200
152799170,6cyclictest13218-21kworker/0:007:36:470
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional