You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-17 - 16:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Wed Dec 17, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2485991080,5rtkit-daemon0-21swapper/007:21:320
2485991030,7rtkit-daemon0-21swapper/007:47:530
2485991010,7rtkit-daemon0-21swapper/008:23:520
248599980,6rtkit-daemon0-21swapper/007:41:010
248599980,6rtkit-daemon0-21swapper/007:41:010
248599980,6rtkit-daemon0-21swapper/007:31:010
248599980,6rtkit-daemon0-21swapper/007:16:090
248599970,7rtkit-daemon0-21swapper/008:09:220
248599970,7rtkit-daemon0-21swapper/007:37:310
248599970,6rtkit-daemon0-21swapper/008:20:070
248599970,6rtkit-daemon0-21swapper/007:59:080
248599970,6rtkit-daemon0-21swapper/007:30:090
248599970,6rtkit-daemon0-21swapper/007:12:390
248599970,6rtkit-daemon0-21swapper/007:12:390
248599960,6rtkit-daemon0-21swapper/008:13:220
248599960,6rtkit-daemon0-21swapper/008:01:300
248599960,6rtkit-daemon0-21swapper/007:51:450
248599960,6rtkit-daemon0-21swapper/007:51:450
248599960,6rtkit-daemon0-21swapper/007:10:090
248599900,5rtkit-daemon0-21swapper/008:25:590
248599810,8rtkit-daemon0-21swapper/007:26:091
248599810,7rtkit-daemon3-21ksoftirqd/007:31:091
248599800,9rtkit-daemon0-21swapper/007:41:081
248599800,9rtkit-daemon0-21swapper/007:41:081
248599800,6rtkit-daemon15-21rcuc/007:51:231
248599800,6rtkit-daemon15-21rcuc/007:51:231
248599800,6rtkit-daemon12-21rcu_preempt07:06:171
248599790,8rtkit-daemon0-21swapper/008:16:071
248599780,7rtkit-daemon0-21swapper/008:13:521
248599780,7rtkit-daemon0-21swapper/007:17:091
248599780,10rtkit-daemon15-21rcuc/008:05:001
248599770,10rtkit-daemon0-21swapper/007:11:541
248599770,10rtkit-daemon0-21swapper/007:11:541
248599760,8rtkit-daemon0-21swapper/007:36:081
248599760,7rtkit-daemon0-21swapper/007:56:081
248599760,10rtkit-daemon0-21swapper/007:21:091
16793996212,41cyclictest0-21swapper/112:15:441
222342614,50sleep00-21swapper/011:46:010
125092613,51sleep312577-21sed09:11:053
1679599604,48cyclictest0-21swapper/311:05:583
16794996032,12cyclictest0-21swapper/210:41:082
1679399603,49cyclictest0-21swapper/110:22:381
16794995932,12cyclictest0-21swapper/207:06:212
60452584,47sleep00-21swapper/012:20:550
1679599585,47cyclictest0-21swapper/311:15:293
1679599583,49cyclictest0-21swapper/310:46:063
281312573,10sleep00-21swapper/008:36:080
281312573,10sleep00-21swapper/008:36:080
196022573,47sleep20-21swapper/208:16:232
16795995733,8cyclictest21393-21latency_hist11:45:453
16793995737,13cyclictest26717-21cut11:55:571
78542564,45sleep00-21swapper/011:16:030
50572567,12sleep20-21swapper/207:46:202
254482563,45sleep20-21swapper/211:51:152
1679599566,15cyclictest0-21swapper/308:41:223
16793995623,11cyclictest12030-21memory10:16:111
16788995636,13cyclictest11765-21sed10:16:070
95252553,44sleep20-21swapper/209:05:522
318242553,45sleep30-21swapper/309:51:063
238102553,9sleep00-21swapper/009:35:200
1679599553,45cyclictest0-21swapper/309:01:163
16794995528,13cyclictest0-21swapper/210:10:492
16788995538,11cyclictest9352-21gltestperf10:11:080
16788995538,11cyclictest31553-21cpuspeed_turbos09:51:020
16788995538,11cyclictest13274-21cat09:11:140
1679599544,29cyclictest0-21swapper/312:35:433
16795995432,13cyclictest0-21swapper/308:31:153
1679599543,44cyclictest24684-21munin-node09:36:063
1679599542,46cyclictest0-21swapper/310:06:143
1679399543,44cyclictest0-21swapper/108:56:131
16788995438,10cyclictest20097-21grep11:41:040
16788995435,12cyclictest9084-21grep09:01:250
1679599534,43cyclictest13129-21sshd08:05:523
16795995325,12cyclictest0-21swapper/310:26:163
16795995323,13cyclictest0-21swapper/310:40:423
16794995328,12cyclictest0-21swapper/208:11:152
1679399533,44cyclictest0-21swapper/110:01:101
1679399533,44cyclictest0-21swapper/110:01:101
1678899535,18cyclictest0-21swapper/009:30:500
16788995336,10cyclictest2833-21cpuspeed_turbos11:05:590
16788995320,12cyclictest0-21swapper/012:11:140
16788995318,14cyclictest0-21swapper/008:41:100
326422523,42sleep0311-21tr08:46:070
324652523,42sleep132212-21yum-updatesd-he08:45:561
178232523,43sleep00-21swapper/010:30:370
16794995230,10cyclictest0-21swapper/210:40:242
16794995225,12cyclictest0-21swapper/209:31:202
16794995222,13cyclictest0-21swapper/210:01:032
16794995222,13cyclictest0-21swapper/210:01:032
1678899525,28cyclictest0-21swapper/009:20:500
1678899525,28cyclictest0-21swapper/009:20:500
16788995235,9cyclictest10028-21grep11:20:590
16788995235,11cyclictest300-21cpuspeed_turbos11:01:000
16788995235,11cyclictest13254-21grep11:26:100
16788995235,11cyclictest13254-21grep11:26:100
1678899523,26cyclictest0-21swapper/009:41:010
16788995220,12cyclictest0-21swapper/012:01:190
154542523,7sleep315606-21sed10:25:483
127382522,43sleep10-21swapper/112:32:491
1679599514,42cyclictest0-21swapper/311:35:463
1679599514,25cyclictest22581-21gltestperf09:31:093
1679599514,15cyclictest0-21swapper/312:21:133
16795995135,10cyclictest25048-21gltestperf07:21:153
1679499513,42cyclictest0-21swapper/209:06:102
16793995134,11cyclictest3900-21tail07:46:051
16793995134,11cyclictest17747-21tail09:21:101
1679399513,42cyclictest0-21swapper/111:40:561
1679399513,41cyclictest0-21swapper/111:10:281
1679399513,20cyclictest0-21swapper/112:09:481
1679399513,20cyclictest0-21swapper/112:09:481
16793995123,11cyclictest32751-21switchtime09:51:201
16793995113,10cyclictest0-21swapper/108:31:041
1678899515,26cyclictest0-21swapper/009:46:160
1678899513,28cyclictest0-21swapper/008:31:100
1678899513,27cyclictest0-21swapper/010:01:020
1678899513,27cyclictest0-21swapper/010:01:020
16788995120,12cyclictest0-21swapper/009:56:110
16788995117,14cyclictest0-21swapper/009:21:130
153742513,42sleep00-21swapper/010:24:530
140342512,9sleep30-21swapper/311:28:393
140342512,9sleep30-21swapper/311:28:393
139252512,43sleep10-21swapper/111:27:121
139252512,43sleep10-21swapper/111:27:121
82242502,42sleep10-21swapper/110:10:071
5972503,9sleep00-21swapper/012:07:210
5972503,9sleep00-21swapper/012:07:210
295702502,9sleep10-21swapper/108:37:171
295702502,9sleep10-21swapper/108:37:171
289642503,41sleep00-21swapper/010:51:160
252402503,9sleep00-21swapper/010:45:560
1679599504,30cyclictest0-21swapper/309:06:073
1679599504,29cyclictest0-21swapper/308:10:013
16795995023,11cyclictest0-21swapper/308:16:043
1679499508,8cyclictest121850irq/46-eth009:15:522
1679499505,38cyclictest0-21swapper/210:51:202
1679399504,40cyclictest6046-21munin-node12:20:551
16793995033,11cyclictest9280-21gltestperf12:26:021
16793995032,11cyclictest16197-21unixbench_singl11:31:191
16793995029,14cyclictest0-21swapper/110:26:061
16788995033,11cyclictest20622-21aten_r1power_vo10:36:000
1678899503,30cyclictest0-21swapper/011:51:010
1678899503,28cyclictest0-21swapper/009:06:100
1678899503,25cyclictest0-21swapper/011:00:270
16788995017,14cyclictest0-21swapper/012:30:530
16788995017,13cyclictest0-21swapper/010:06:020
16788995017,12cyclictest0-21swapper/012:26:020
145212502,41sleep10-21swapper/109:15:541
145212502,41sleep10-21swapper/109:15:541
101832503,41sleep110310-21sed09:06:071
307312492,41sleep10-21swapper/109:47:141
26752492,9sleep20-21swapper/207:41:212
26752492,9sleep20-21swapper/207:41:212
240902494,39sleep024118-21telnet09:36:000
226632493,38sleep00-21swapper/010:40:490
188562492,41sleep10-21swapper/111:39:051
1679599494,30cyclictest0-21swapper/310:51:003
1679599494,22cyclictest0-21swapper/311:50:563
1679499495,38cyclictest0-21swapper/210:30:422
16793994932,11cyclictest7588-21tr11:16:001
1679399493,39cyclictest0-21swapper/111:01:121
1678899495,14cyclictest0-21swapper/012:16:120
1678899494,26cyclictest0-21swapper/011:10:580
1678899494,26cyclictest0-21swapper/010:31:040
1678899494,26cyclictest0-21swapper/008:56:070
1678899493,23cyclictest0-21swapper/008:51:150
16788994917,13cyclictest0-21swapper/011:56:060
16788994916,12cyclictest0-21swapper/011:40:330
154862492,9sleep10-21swapper/108:10:251
319522482,39sleep10-21swapper/108:42:171
295822482,9sleep30-21swapper/308:37:283
295822482,9sleep30-21swapper/308:37:283
272592482,40sleep20-21swapper/208:33:192
271252483,38sleep20-21swapper/211:56:032
235022482,39sleep20-21swapper/208:26:102
223182482,40sleep10-21swapper/110:36:591
1679599487,24cyclictest0-21swapper/307:56:263
16795994820,11cyclictest0-21swapper/310:56:183
16794994827,9cyclictest0-21swapper/212:20:452
16794994827,10cyclictest0-21swapper/212:25:452
16794994823,8cyclictest15452-21latency_hist10:25:482
16794994821,11cyclictest13075-21ls12:35:432
1679399483,40cyclictest0-21swapper/109:56:191
1679399483,37cyclictest0-21swapper/109:36:021
16793994824,8cyclictest25281-21ntp_states11:51:111
16793994824,18cyclictest201ktimersoftd/111:21:141
1678899484,22cyclictest0-21swapper/011:31:110
166892484,38sleep20-21swapper/207:05:052
141122482,9sleep10-21swapper/109:13:361
103752482,40sleep10-21swapper/110:12:041
317472472,9sleep30-21swapper/312:05:593
317472472,9sleep30-21swapper/312:05:593
1679599475,29cyclictest0-21swapper/310:11:203
1679599475,27cyclictest0-21swapper/307:31:083
16795994732,10cyclictest28553-21crond12:00:443
16795994730,10cyclictest29997-21needreboot12:01:093
1679599473,10cyclictest0-21swapper/307:16:073
16795994728,13cyclictest0-21swapper/309:16:093
16795994728,13cyclictest0-21swapper/309:16:093
16795994727,13cyclictest0-21swapper/307:06:223
1679499478,32cyclictest0-21swapper/207:26:262
1679499474,36cyclictest0-21swapper/212:10:582
1679499474,36cyclictest0-21swapper/207:31:232
1679499473,37cyclictest0-21swapper/208:00:552
16794994722,11cyclictest0-21swapper/211:06:002
1679399474,36cyclictest0-21swapper/109:26:021
16793994732,10cyclictest30153-21processes12:01:121
16793994724,8cyclictest27556-21cat10:50:481
16793994724,10cyclictest1419-21runrttasks08:51:041
16793994718,14cyclictest0-21swapper/109:01:051
294542462,38sleep10-21swapper/110:51:421
236542462,38sleep10-21swapper/111:49:211
228472462,9sleep30-21swapper/310:40:563
225542462,38sleep10-21swapper/109:31:101
1679599466,33cyclictest1419-21runrttasks07:11:063
1679599466,33cyclictest1419-21runrttasks07:11:063
1679599465,13cyclictest1360-21taskset12:10:553
1679599465,13cyclictest0-21swapper/309:56:063
1679599464,37cyclictest0-21swapper/310:01:053
1679599464,37cyclictest0-21swapper/310:01:053
1679599464,35cyclictest0-21swapper/309:50:503
1679599464,28cyclictest0-21swapper/309:21:083
1679599464,27cyclictest0-21swapper/309:00:523
1679599463,10cyclictest0-21swapper/308:46:063
1679599463,10cyclictest0-21swapper/307:36:243
16795994626,15cyclictest0-21swapper/308:25:533
16795994625,14cyclictest0-21swapper/307:45:453
16795994625,14cyclictest0-21swapper/307:45:453
16795994615,12cyclictest0-21swapper/311:16:203
16795994610,30cyclictest0-21swapper/311:20:573
1679499464,36cyclictest0-21swapper/211:46:062
1679499464,36cyclictest0-21swapper/209:41:142
1679499464,34cyclictest0-21swapper/212:06:032
1679499464,34cyclictest0-21swapper/212:06:032
1679499464,34cyclictest0-21swapper/210:56:022
1679499464,34cyclictest0-21swapper/209:26:082
1679499463,26cyclictest0-21swapper/208:56:092
16794994626,9cyclictest0-21swapper/212:05:452
16794994625,10cyclictest0-21swapper/211:11:132
16794994625,10cyclictest0-21swapper/210:31:262
16794994625,10cyclictest0-21swapper/207:36:062
16794994622,11cyclictest0-21swapper/207:21:112
16794994621,13cyclictest0-21swapper/210:15:592
16794994619,12cyclictest0-21swapper/207:11:062
16794994619,12cyclictest0-21swapper/207:11:062
16794994618,11cyclictest0-21swapper/211:40:572
16793994623,7cyclictest28601-21yum-updatesd-he09:45:381
16793994622,8cyclictest1287-21snmpd11:15:291
16793994620,9cyclictest22851-21munin-node10:41:031
128432462,9sleep20-21swapper/208:02:122
92842452,36sleep20-21swapper/211:18:552
1679599454,35cyclictest0-21swapper/308:51:043
1679599454,34cyclictest0-21swapper/309:45:503
1679599454,34cyclictest0-21swapper/307:05:563
1679599453,10cyclictest0-21swapper/308:11:043
16795994528,13cyclictest0-21swapper/309:26:073
16795994524,16cyclictest0-21swapper/310:20:483
16795994517,14cyclictest0-21swapper/311:36:073
1679499455,34cyclictest0-21swapper/210:46:052
1679499454,34cyclictest0-21swapper/208:55:522
1679499453,11cyclictest0-21swapper/211:01:032
16793994530,9cyclictest31734-21unixbench_multi10:56:201
104212452,9sleep20-21swapper/210:12:422
5952442,36sleep20-21swapper/209:51:302
55382442,9sleep30-21swapper/312:17:163
236022442,9sleep20-21swapper/207:16:422
19932442,9sleep30-21swapper/311:03:413
189922442,36sleep20-21swapper/209:24:462
1679599444,28cyclictest0-21swapper/307:54:583
1679599444,28cyclictest0-21swapper/307:54:583
1679599444,27cyclictest0-21swapper/310:31:003
1679599444,14cyclictest0-21swapper/311:45:543
1679599443,23cyclictest27300-21munin-node07:26:123
1679599443,13cyclictest0-21swapper/312:28:523
16795994424,13cyclictest0-21swapper/308:26:073
1679499444,35cyclictest0-21swapper/209:36:062
1679499443,36cyclictest0-21swapper/208:41:262
16794994421,11cyclictest0-21swapper/209:16:172
16794994421,11cyclictest0-21swapper/209:16:172
16794994420,9cyclictest13967-21fschecks_count08:06:102
16794994416,11cyclictest0-21swapper/209:59:532
1679399444,13cyclictest0-21swapper/108:23:521
1679399443,33cyclictest18645-21df_inode10:31:031
1679599434,14cyclictest0-21swapper/307:45:573
1679499435,32cyclictest0-21swapper/208:48:582
1679499434,33cyclictest0-21swapper/209:46:052
1679499434,32cyclictest0-21swapper/207:51:062
1679499434,32cyclictest0-21swapper/207:51:062
16794994322,8cyclictest22203-21sed08:21:252
1679499432,36cyclictest0-21swapper/208:36:252
1679499432,36cyclictest0-21swapper/208:36:252
1679499432,11cyclictest0-21swapper/211:21:002
16793994326,12cyclictest0-21swapper/112:15:551
1678899434,12cyclictest0-21swapper/007:05:570
140972432,34sleep20-21swapper/211:29:272
140972432,34sleep20-21swapper/211:29:272
1679499425,32cyclictest0-21swapper/212:26:012
1679499424,12cyclictest0-21swapper/211:35:572
16793994220,10cyclictest23183-21cpuspeed08:26:071
1679499412,35cyclictest0-21swapper/211:31:072
16793993910,13cyclictest0-21swapper/107:05:561
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional