You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-08 - 15:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Mon Dec 08, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
386921190,36sleep23870-21strings08:24:092
192479910546,52cyclictest0-21swapper/007:48:460
192519910042,14cyclictest0-21swapper/107:04:171
1925399953,12cyclictest0-21swapper/311:33:353
1925399933,12cyclictest0-21swapper/309:23:403
19247999233,14cyclictest0-21swapper/010:38:520
243799910,4rtkit-daemon2436-21rtkit-daemon09:24:093
1925399913,8cyclictest9524-21seq10:53:373
1925399863,10cyclictest20382-21crond07:53:443
1925399844,14cyclictest0-21swapper/308:13:543
1925399844,14cyclictest0-21swapper/308:13:543
1925399835,56cyclictest0-21swapper/310:27:163
1925399834,11cyclictest0-21swapper/310:54:113
1925399833,9cyclictest18769-21grep08:54:163
1925399833,9cyclictest18769-21grep08:54:163
1925399833,56cyclictest11015-21cat08:39:073
1925399825,55cyclictest3389-1kworker/3:2H07:44:153
1925399824,69cyclictest0-21swapper/309:14:003
1925399824,12cyclictest0-21swapper/309:53:583
19253998214,45cyclictest32723-21python11:39:103
19253998214,44cyclictest0-21swapper/306:54:043
1925399814,69cyclictest0-21swapper/311:53:583
1925399814,51cyclictest0-21swapper/307:08:583
1925399814,49cyclictest0-21swapper/309:08:503
1925399814,12cyclictest0-21swapper/308:13:433
1925399813,11cyclictest0-21swapper/307:14:133
1925399804,54cyclictest0-21swapper/310:38:503
1925399804,13cyclictest0-21swapper/311:44:033
1925399804,13cyclictest0-21swapper/311:44:033
1925399803,9cyclictest27545-21crond08:08:433
1925399803,8cyclictest7150irq/45-ahci08:29:073
1925399803,13cyclictest0-21swapper/312:04:083
1925399794,68cyclictest0-21swapper/307:58:443
1925399794,54cyclictest0-21swapper/308:46:023
1925399794,51cyclictest0-21swapper/307:19:163
1925399794,12cyclictest0-21swapper/310:13:403
1925399793,10cyclictest30128-21seq10:28:503
19253997916,44cyclictest0-21swapper/310:19:123
19253997916,44cyclictest0-21swapper/310:19:123
19253997914,43cyclictest0-21swapper/307:39:063
1925399785,8cyclictest7150irq/45-ahci12:03:353
1925399785,55cyclictest0-21swapper/308:34:433
1925399784,59cyclictest0-21swapper/310:37:173
1925399784,51cyclictest0-21swapper/308:49:023
1925399784,50cyclictest0-21swapper/311:36:333
1925399784,50cyclictest0-21swapper/308:24:053
1925399784,12cyclictest0-21swapper/310:44:113
1925399784,12cyclictest0-21swapper/306:44:193
1925399774,13cyclictest0-21swapper/309:42:083
1925399774,12cyclictest0-21swapper/307:04:183
1925399773,53cyclictest0-21swapper/309:58:533
1925399773,52cyclictest0-21swapper/307:29:123
1925399764,12cyclictest0-21swapper/311:17:253
1925399764,12cyclictest0-21swapper/311:13:373
1925399764,12cyclictest0-21swapper/306:49:173
1925399763,8cyclictest3810-21runrttasks09:33:433
1925399763,52cyclictest0-21swapper/311:23:493
239202750,3sleep212-21rcu_preempt07:59:022
1925399754,64cyclictest0-21swapper/310:13:513
1925399754,55cyclictest26688-21aten2.4-expect06:58:593
1925399753,9cyclictest18183-21aten_r1power_cu10:03:513
19253997515,43cyclictest23003-21munin-node07:59:133
1925399746,8cyclictest114550irq/46-eth011:02:223
1925399746,8cyclictest114550irq/46-eth011:02:223
1925399744,61cyclictest0-21swapper/311:04:123
1925399744,61cyclictest0-21swapper/307:34:033
1925399744,54cyclictest0-21swapper/309:49:473
1925399743,8cyclictest5793-21taskset11:52:093
1925399743,51cyclictest0-21swapper/309:03:543
19253997413,54cyclictest2009-21fschecks_time09:28:593
1925399734,12cyclictest0-21swapper/308:58:453
19253997312,52cyclictest0-21swapper/308:19:023
1925399724,53cyclictest0-21swapper/309:47:093
1925399713,60cyclictest0-21swapper/311:19:103
1925399704,59cyclictest0-21swapper/307:24:213
1925399692,55cyclictest0-21swapper/312:08:473
243799670,5rtkit-daemon2436-21rtkit-daemon09:54:152
1925399663,12cyclictest0-21swapper/306:43:473
243799640,4rtkit-daemon2436-21rtkit-daemon07:39:202
1925299645,51cyclictest0-21swapper/208:49:032
243799630,4rtkit-daemon2436-21rtkit-daemon11:08:572
243799630,11rtkit-daemon0-21swapper/207:14:292
243799630,11rtkit-daemon0-21swapper/206:49:522
243799630,10rtkit-daemon0-21swapper/209:24:012
302232620,10sleep030224-21strings07:04:110
243799620,7rtkit-daemon0-21swapper/211:34:042
243799620,5rtkit-daemon2436-21rtkit-daemon07:29:062
243799620,4rtkit-daemon2436-21rtkit-daemon08:10:122
243799610,11rtkit-daemon0-21swapper/210:34:592
243799610,10rtkit-daemon0-21swapper/209:34:082
243799610,10rtkit-daemon0-21swapper/207:50:052
1925299615,30cyclictest0-21swapper/209:53:402
19247996146,8cyclictest15454-21munin-run12:13:340
243799600,9rtkit-daemon0-21swapper/210:39:132
1925299604,24cyclictest0-21swapper/210:43:492
19251996045,10cyclictest0-21swapper/110:29:101
129692603,8sleep213047-21grep08:44:022
243799590,11rtkit-daemon0-21swapper/206:44:152
19251995840,12cyclictest0-21swapper/107:09:131
94842572,47sleep00-21swapper/010:53:090
19252995739,10cyclictest15770-21munin-node09:59:022
1925199573,48cyclictest0-21swapper/108:29:151
1925199572,49cyclictest0-21swapper/108:03:571
1925299565,30cyclictest0-21swapper/206:59:132
19251995639,12cyclictest0-21swapper/111:09:041
19251995638,13cyclictest0-21swapper/109:41:481
19251995638,12cyclictest0-21swapper/107:34:091
19247995641,10cyclictest0-21swapper/009:43:520
37702552,46sleep10-21swapper/110:39:041
1925299555,29cyclictest0-21swapper/210:48:472
1925299554,31cyclictest0-21swapper/210:09:042
1925299554,30cyclictest0-21swapper/206:54:122
19252995537,11cyclictest14174-21gltestperf12:08:552
19252995535,12cyclictest21063-21grep11:14:122
19252995521,14cyclictest0-21swapper/207:09:162
19252995521,13cyclictest0-21swapper/207:34:082
1925199553,46cyclictest0-21swapper/110:48:481
19247995538,11cyclictest0-21swapper/011:59:070
19247995515,35cyclictest9348-21fschecks_time07:29:060
149632553,9sleep00-21swapper/011:03:540
104062553,12sleep20-21swapper/212:00:062
243799540,6rtkit-daemon2436-21rtkit-daemon06:39:150
1925299544,31cyclictest0-21swapper/207:54:122
1925299544,30cyclictest0-21swapper/209:44:102
1925299544,30cyclictest0-21swapper/208:14:172
1925299544,30cyclictest0-21swapper/208:14:172
1925299544,29cyclictest0-21swapper/211:28:372
1925299544,29cyclictest0-21swapper/209:19:082
19252995436,10cyclictest13002-21cut10:58:572
19252995436,10cyclictest13002-21cut10:58:572
19252995434,12cyclictest22513-21gltestperf11:18:562
19252995421,13cyclictest0-21swapper/211:53:362
19252995421,13cyclictest0-21swapper/209:08:592
19252995418,15cyclictest0-21swapper/210:04:012
1925299534,31cyclictest0-21swapper/210:29:032
1925299534,30cyclictest0-21swapper/208:33:432
1925299534,28cyclictest0-21swapper/207:19:022
1925299534,26cyclictest0-21swapper/208:58:512
1925299533,11cyclictest0-21swapper/211:38:512
19252995322,13cyclictest0-21swapper/208:04:092
19252995321,13cyclictest0-21swapper/209:04:012
19252995320,14cyclictest0-21swapper/210:24:072
19251995337,9cyclictest1369-21runrttasks10:01:591
1925199533,44cyclictest0-21swapper/108:39:121
1924799535,12cyclictest0-21swapper/009:38:310
19247995342,6cyclictest30882sleep008:23:590
19247995334,13cyclictest0-21swapper/010:09:030
19247995322,26cyclictest0-21swapper/009:03:190
1924799532,43cyclictest0-21swapper/011:18:490
215152524,10sleep00-21swapper/006:47:310
1925299524,29cyclictest0-21swapper/208:19:162
1925299524,29cyclictest0-21swapper/207:44:092
1925299524,28cyclictest0-21swapper/207:04:092
1925299524,27cyclictest0-21swapper/211:33:362
1925299524,26cyclictest9582-21yum-updatesd-he08:38:542
19252995233,11cyclictest25663-21cpuspeed_turbos10:18:552
19252995233,11cyclictest25663-21cpuspeed_turbos10:18:552
19252995220,13cyclictest0-21swapper/211:48:362
19252995211,22cyclictest726-1kworker/2:0H07:24:092
19252995211,21cyclictest0-21swapper/212:03:472
19251995238,8cyclictest10812-21munin-run07:33:451
19251995235,12cyclictest0-21swapper/110:08:401
19251995235,12cyclictest0-21swapper/109:45:381
1925199523,44cyclictest0-21swapper/109:57:111
1925199523,44cyclictest0-21swapper/108:46:451
19247995237,10cyclictest0-21swapper/009:24:130
19247995237,10cyclictest0-21swapper/007:09:130
1924799523,43cyclictest0-21swapper/008:09:140
1924799522,41cyclictest24246-21munin-node06:54:050
19247995215,31cyclictest0-21swapper/007:58:440
113182522,43sleep00-21swapper/012:03:510
44752512,10sleep10-21swapper/108:24:261
284202512,10sleep20-21swapper/209:14:572
272562513,41sleep10-21swapper/110:20:501
272562513,41sleep10-21swapper/110:20:501
237962512,42sleep00-21swapper/009:06:570
1925299514,28cyclictest0-21swapper/211:44:032
19252995119,13cyclictest0-21swapper/210:54:072
19252995118,14cyclictest0-21swapper/209:32:072
19252995118,13cyclictest0-21swapper/211:54:012
19251995134,13cyclictest0-21swapper/111:29:351
19251995134,12cyclictest0-21swapper/109:28:461
1925199513,43cyclictest0-21swapper/111:39:341
1925199513,43cyclictest0-21swapper/108:48:581
1925199513,43cyclictest0-21swapper/106:54:051
1924799514,39cyclictest0-21swapper/009:19:150
19247995137,9cyclictest17191-21sendmail_mailqu09:59:100
19247995134,10cyclictest30591-21unixbench_multi11:34:100
19247995127,11cyclictest0-21swapper/008:49:180
134722513,41sleep10-21swapper/110:59:071
134722513,41sleep10-21swapper/110:59:071
130392516,10sleep10-21swapper/112:08:191
7982503,42sleep00-21swapper/011:41:300
58482506,10sleep00-21swapper/007:21:210
34632503,10sleep10-21swapper/111:47:521
34632503,10sleep10-21swapper/111:47:521
321502505,10sleep00-21swapper/010:32:260
1925299505,26cyclictest0-21swapper/208:57:012
1925299505,26cyclictest0-21swapper/208:57:012
1925299504,27cyclictest0-21swapper/210:13:522
1925299504,27cyclictest0-21swapper/208:34:002
1925299504,26cyclictest0-21swapper/211:07:232
1925299504,25cyclictest0-21swapper/209:38:542
1925199507,37cyclictest0-21swapper/110:24:081
1925199504,39cyclictest0-21swapper/111:33:561
1925199503,42cyclictest0-21swapper/108:16:541
1925199503,42cyclictest0-21swapper/108:16:541
1925199503,31cyclictest24784-21cut09:09:001
19247995036,9cyclictest13686-21cpuspeed_turbos09:53:530
19247995035,9cyclictest3216-21unixbench_multi07:14:180
19247995034,11cyclictest14292-21tail07:39:050
19247995034,11cyclictest0-21swapper/008:34:100
19247995034,11cyclictest0-21swapper/008:29:130
19247995034,11cyclictest0-21swapper/007:33:570
19247995031,13cyclictest0-21swapper/009:39:000
19247995026,11cyclictest0-21swapper/011:54:080
82602493,40sleep10-21swapper/107:26:421
59652493,40sleep10-21swapper/110:43:591
283892492,10sleep00-21swapper/009:14:350
272852494,10sleep00-21swapper/010:21:130
272852494,10sleep00-21swapper/010:21:130
250542492,41sleep10-21swapper/108:02:251
243799490,5rtkit-daemon2436-21rtkit-daemon06:39:301
1925199495,37cyclictest0-21swapper/108:34:001
1925199494,39cyclictest0-21swapper/108:13:431
19251994936,8cyclictest32513-21sed09:24:051
19251994934,11cyclictest0-21swapper/107:42:081
19251994934,10cyclictest0-21swapper/106:58:591
19251994933,11cyclictest0-21swapper/107:53:571
19251994932,13cyclictest0-21swapper/110:09:101
19251994932,12cyclictest0-21swapper/111:27:171
1925199493,41cyclictest0-21swapper/112:08:541
1925199493,40cyclictest1552-21rt-features08:19:141
19247994938,7cyclictest0-21swapper/009:53:400
19247994935,9cyclictest13856-21grep10:59:110
19247994935,9cyclictest13856-21grep10:59:110
19247994934,10cyclictest0-21swapper/010:24:040
1924799493,20cyclictest0-21swapper/010:16:300
19247994924,12cyclictest0-21swapper/008:54:070
19247994924,12cyclictest0-21swapper/008:54:070
1924799492,41cyclictest0-21swapper/008:44:480
58902483,10sleep00-21swapper/011:53:270
287482483,10sleep00-21swapper/007:03:270
259572482,10sleep00-21swapper/011:24:570
20222483,39sleep00-21swapper/010:35:400
200702483,38sleep10-21swapper/107:49:431
19732483,39sleep10-21swapper/110:35:011
1925199486,35cyclictest0-21swapper/109:04:061
1925199484,38cyclictest0-21swapper/110:58:371
1925199484,25cyclictest21852-21munin-node06:48:591
19247994833,11cyclictest0-21swapper/006:49:030
19247994830,13cyclictest0-21swapper/011:09:030
1924799483,38cyclictest0-21swapper/008:03:580
1924799483,37cyclictest0-21swapper/011:13:500
1924799483,25cyclictest0-21swapper/010:46:490
1924799483,23cyclictest0-21swapper/008:21:450
1925199475,36cyclictest0-21swapper/111:48:551
1925199474,38cyclictest0-21swapper/109:38:411
1925199474,15cyclictest0-21swapper/112:01:331
19251994733,10cyclictest0-21swapper/107:44:441
19251994725,16cyclictest0-21swapper/109:49:071
1924799479,32cyclictest0-21swapper/010:53:580
19247994732,10cyclictest0-21swapper/008:14:010
19247994732,10cyclictest0-21swapper/008:14:010
19247994730,12cyclictest0-21swapper/009:10:280
19247994729,13cyclictest0-21swapper/010:04:140
19247994728,14cyclictest0-21swapper/011:32:280
19247994722,12cyclictest0-21swapper/007:48:570
118352472,39sleep00-21swapper/008:41:500
32642464,36sleep00-21swapper/009:29:340
286752463,38sleep10-21swapper/109:18:191
237432462,37sleep10-21swapper/111:22:201
211812463,37sleep10-21swapper/111:14:591
1925199465,34cyclictest0-21swapper/107:18:461
1925199464,25cyclictest0-21swapper/110:13:571
19251994632,9cyclictest6175-21tail11:53:491
19251994629,12cyclictest17874-21tail08:54:021
19251994629,12cyclictest17874-21tail08:54:021
19247994631,10cyclictest23936-21hwlatdetect07:59:020
213322453,37sleep10-21swapper/106:45:061
1925199455,35cyclictest0-21swapper/111:04:091
1925199453,35cyclictest0-21swapper/107:18:581
19247994531,9cyclictest7483-21needreboot07:24:110
19247994525,14cyclictest0-21swapper/011:44:070
19247994525,14cyclictest0-21swapper/011:44:070
1925199443,36cyclictest0-21swapper/109:18:551
1925199443,12cyclictest0-21swapper/108:59:091
1925299422,25cyclictest0-21swapper/206:43:482
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional