You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-20 - 09:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Fri Mar 20, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
172599910443,10cyclictest1419-21runrttasks22:19:092
1726099993,89cyclictest22935-21seq21:32:293
40802930,11sleep21725999cyclictest20:14:582
1725999934,27cyclictest0-21swapper/219:39:142
307492910,15sleep11725899cyclictest20:08:571
248599890,6rtkit-daemon2484-21rtkit-daemon22:12:102
1726099892,47cyclictest0-21swapper/322:17:033
1726099883,77cyclictest1419-21runrttasks22:34:413
1726099863,75cyclictest8535-21unixbench_multi21:09:273
1726099863,36cyclictest19626-21crond17:44:023
1726099863,36cyclictest19626-21crond17:44:023
1726099853,75cyclictest4198-21python22:39:213
1726099844,72cyclictest0-21swapper/323:04:093
1726099833,72cyclictest1875-21munin-node21:49:093
1726099833,72cyclictest1287-21snmpd20:54:413
1726099824,71cyclictest0-21swapper/320:21:073
1726099824,59cyclictest0-21swapper/322:03:233
1726099814,69cyclictest0-21swapper/321:44:033
1726099814,68cyclictest0-21swapper/319:44:183
1726099813,71cyclictest28408-21ssh20:04:153
1726099813,71cyclictest0-21swapper/321:05:573
1726099813,63cyclictest20956-21seq20:40:123
1726099813,63cyclictest20956-21seq20:40:123
1726099813,63cyclictest0-21swapper/321:58:163
1726099813,61cyclictest0-21swapper/321:23:543
1726099813,61cyclictest0-21swapper/321:23:543
1726099804,70cyclictest0-21swapper/321:03:513
1726099804,69cyclictest0-21swapper/321:24:253
1726099804,59cyclictest0-21swapper/322:55:433
1726099803,70cyclictest9990-21diskmemload22:21:173
1726099803,70cyclictest0-21swapper/320:29:193
1726099803,69cyclictest0-21swapper/320:27:053
1726099803,67cyclictest25231-21cpuspeed_turbos22:24:063
1726099803,56cyclictest14960-21hostname22:09:033
1726099794,69cyclictest0-21swapper/322:06:243
1726099794,68cyclictest0-21swapper/322:29:273
1726099794,59cyclictest0-21swapper/320:44:073
1726099793,70cyclictest17794-21fschecks_count19:49:163
1726099793,69cyclictest28157-21sshd20:51:583
1726099793,68cyclictest23161-21crond18:58:593
1726099793,57cyclictest0-21swapper/320:00:503
17260997923,37cyclictest121850irq/46-eth020:18:563
17260997916,43cyclictest11058-21fw_packets19:39:173
1726099784,67cyclictest4047-21crond18:19:003
1726099784,67cyclictest0-21swapper/319:54:193
1726099784,67cyclictest0-21swapper/319:54:193
1726099784,54cyclictest0-21swapper/321:43:033
1726099783,69cyclictest0-21swapper/322:59:103
1726099783,68cyclictest733-21runrttasks18:09:293
1726099783,68cyclictest0-21swapper/318:39:313
248599770,9rtkit-daemon0-21swapper/020:44:060
248599770,10rtkit-daemon0-21swapper/122:44:312
1726099773,67cyclictest7899-21uptime22:44:253
1726099773,66cyclictest11233-21munin-run18:34:003
1726099773,66cyclictest11233-21munin-run18:34:003
248599760,7rtkit-daemon0-21swapper/019:51:300
1726099764,65cyclictest31564-21ls18:09:013
1726099763,66cyclictest19886-21aten2.4-expect17:44:123
1726099763,66cyclictest10866-21fschecks_time21:14:113
1726099763,66cyclictest0-21swapper/320:36:303
1726099763,66cyclictest0-21swapper/320:36:303
1726099763,65cyclictest0-21swapper/320:09:563
248599750,9rtkit-daemon0-21swapper/020:36:290
248599750,9rtkit-daemon0-21swapper/020:36:290
17260997520,31cyclictest9990-21diskmemload21:34:173
1726099743,65cyclictest1419-21runrttasks22:49:163
1726099743,64cyclictest6318-21smartctl19:29:153
1726099743,64cyclictest18628-21munin-node18:49:263
1726099743,53cyclictest16399-21cpu18:44:133
248599730,7rtkit-daemon0-21swapper/120:08:302
1726099733,56cyclictest0-21swapper/317:54:033
17260997231,32cyclictest32709-21crond19:18:583
1726099723,62cyclictest1287-21snmpd19:09:333
1726099723,62cyclictest1287-21snmpd19:09:333
1726099723,43cyclictest23403-21munin-node18:59:113
1726099714,60cyclictest0-21swapper/317:59:033
248599700,8rtkit-daemon0-21swapper/121:32:040
1726099703,59cyclictest8956-21load19:34:223
1726099703,58cyclictest815-21cpuspeed_turbos19:19:123
1726099703,52cyclictest26798-21interrupts19:04:203
1726099694,42cyclictest0-21swapper/318:22:443
1726099693,38cyclictest7409-21cut18:24:183
1726099693,38cyclictest7409-21cut18:24:183
1726099684,57cyclictest0-21swapper/318:34:303
1726099674,46cyclictest0-21swapper/319:24:193
17257996711,21cyclictest9990-21diskmemload21:24:120
248599660,8rtkit-daemon9427-21sed19:34:310
248599660,4rtkit-daemon2484-21rtkit-daemon22:17:552
1726099663,57cyclictest27020-21munin-node17:59:103
17258996620,27cyclictest19878-21timerwakeupswit22:14:251
248599650,6rtkit-daemon12-21rcu_preempt18:04:120
248599650,4rtkit-daemon2484-21rtkit-daemon21:51:332
248599640,7rtkit-daemon0-21swapper/121:44:560
248599640,7rtkit-daemon0-21swapper/118:59:400
248599640,6rtkit-daemon22247-21munin-node17:49:200
248599640,6rtkit-daemon11427-21munin-node21:14:200
248599640,5rtkit-daemon2484-21rtkit-daemon18:18:042
248599640,5rtkit-daemon22318-21ssh23:07:530
248599640,4rtkit-daemon2484-21rtkit-daemon21:44:342
248599640,4rtkit-daemon2484-21rtkit-daemon18:57:032
248599630,7rtkit-daemon0-21swapper/120:17:140
248599630,7rtkit-daemon0-21swapper/117:57:270
248599630,7rtkit-daemon0-21swapper/117:44:200
248599630,6rtkit-daemon18-21rcuc/121:19:050
248599630,6rtkit-daemon18-21rcuc/121:19:050
248599630,4rtkit-daemon2484-21rtkit-daemon22:59:462
248599630,4rtkit-daemon2484-21rtkit-daemon21:31:492
248599630,4rtkit-daemon2484-21rtkit-daemon21:20:422
248599630,4rtkit-daemon2484-21rtkit-daemon21:20:422
248599630,4rtkit-daemon2484-21rtkit-daemon18:05:422
248599620,7rtkit-daemon0-21swapper/121:53:030
248599620,7rtkit-daemon0-21swapper/120:33:060
248599620,7rtkit-daemon0-21swapper/120:25:140
248599620,4rtkit-daemon2484-21rtkit-daemon22:54:162
1725899624,12cyclictest0-21swapper/121:19:151
1725899624,12cyclictest0-21swapper/121:19:151
17257996220,33cyclictest6485-21crond21:08:540
265602610,4sleep226-21rcuc/220:01:122
248599610,7rtkit-daemon0-21swapper/118:39:260
248599610,6rtkit-daemon6258-21perl20:19:140
248599610,6rtkit-daemon21-21ksoftirqd/118:00:350
248599610,6rtkit-daemon0-21swapper/122:38:160
248599610,6rtkit-daemon0-21swapper/120:08:520
248599610,3rtkit-daemon2484-21rtkit-daemon20:51:582
248599600,7rtkit-daemon0-21swapper/121:43:040
248599600,6rtkit-daemon0-21swapper/121:09:200
248599600,5rtkit-daemon6669-21munin-node18:24:260
248599600,5rtkit-daemon6669-21munin-node18:24:260
1725999604,46cyclictest0-21swapper/218:49:252
1725999604,24cyclictest0-21swapper/222:40:052
17259996038,14cyclictest0-21swapper/221:54:112
17259996036,16cyclictest0-21swapper/221:39:262
1725899604,12cyclictest0-21swapper/118:24:291
1725899604,12cyclictest0-21swapper/118:24:291
17258996022,10cyclictest13407-21ssh22:04:361
248599590,7rtkit-daemon0-21swapper/119:56:450
248599590,7rtkit-daemon0-21swapper/119:56:450
248599590,6rtkit-daemon0-21swapper/123:00:010
248599590,6rtkit-daemon0-21swapper/120:56:430
248599590,6rtkit-daemon0-21swapper/119:44:530
248599590,6rtkit-daemon0-21swapper/118:44:260
248599590,5rtkit-daemon1287-21snmpd22:05:480
1725999594,28cyclictest0-21swapper/220:24:192
248599580,6rtkit-daemon0-21swapper/118:18:340
17259995826,24cyclictest0-21swapper/220:12:402
1725899584,14cyclictest0-21swapper/119:56:191
1725899584,14cyclictest0-21swapper/119:56:191
1725899584,13cyclictest0-21swapper/120:49:181
1725799583,48cyclictest0-21swapper/022:32:160
168592583,47sleep10-21swapper/119:48:581
280172573,7sleep126959-21munin-node21:39:161
248599570,7rtkit-daemon0-21swapper/122:18:250
248599570,6rtkit-daemon0-21swapper/119:25:310
1726099574,46cyclictest0-21swapper/317:39:033
1725999574,46cyclictest0-21swapper/220:44:092
1725899564,13cyclictest0-21swapper/120:44:571
1725899564,12cyclictest0-21swapper/120:37:191
1725899564,12cyclictest0-21swapper/120:37:191
1725799565,44cyclictest0-21swapper/022:39:090
1725799563,44cyclictest9641-21ssh21:59:240
264442553,44sleep20-21swapper/221:38:002
248599550,6rtkit-daemon0-21swapper/221:09:121
1725999555,43cyclictest0-21swapper/220:58:162
1725999555,26cyclictest0-21swapper/219:19:102
1725999554,43cyclictest0-21swapper/222:34:052
17259995535,13cyclictest0-21swapper/220:39:292
17259995535,13cyclictest0-21swapper/220:39:292
17259995516,21cyclictest0-21swapper/220:22:062
17258995538,10cyclictest17811-21cut17:39:151
17258995538,10cyclictest17811-21cut17:39:151
17258995512,25cyclictest10543-21unixbench-2d20:24:301
1725799557,40cyclictest0-21swapper/020:09:140
17257995519,8cyclictest11447-21ssh22:50:010
98942542,9sleep20-21swapper/219:37:512
65132543,43sleep20-21swapper/219:29:202
1725999545,41cyclictest0-21swapper/221:59:042
1725999544,30cyclictest0-21swapper/220:59:262
17259995434,14cyclictest0-21swapper/221:28:542
17259995423,10cyclictest21717-21ssh19:54:192
17259995423,10cyclictest21717-21ssh19:54:192
17259995413,24cyclictest0-21swapper/220:29:262
1725899544,31cyclictest0-21swapper/122:19:151
17257995410,11cyclictest0-21swapper/022:48:340
132032543,44sleep10-21swapper/122:54:061
17259995332,14cyclictest0-21swapper/218:39:122
1725899534,12cyclictest0-21swapper/123:06:471
1725899534,12cyclictest0-21swapper/120:00:151
17258995336,11cyclictest21896-21gltestperf18:54:201
17258995335,11cyclictest13168-21unixbench_multi18:34:321
1725799537,28cyclictest0-21swapper/022:09:140
1725799535,29cyclictest0-21swapper/022:24:080
17257995326,12cyclictest0-21swapper/019:39:050
17257995323,11cyclictest5496-21ssh21:54:110
11632532,43sleep10-21swapper/120:12:081
324362523,9sleep00-21swapper/019:15:320
242362522,9sleep20-21swapper/217:51:582
1725999525,39cyclictest0-21swapper/222:29:112
1725999525,14cyclictest0-21swapper/221:10:492
1725999524,39cyclictest0-21swapper/218:29:122
1725999524,39cyclictest0-21swapper/218:29:122
17259995233,12cyclictest0-21swapper/222:49:262
17259995229,15cyclictest0-21swapper/222:28:362
17259995223,12cyclictest0-21swapper/221:14:152
1725999522,46cyclictest0-21swapper/221:06:122
17259995217,14cyclictest0-21swapper/219:24:252
1725899524,12cyclictest0-21swapper/118:30:141
1725899524,12cyclictest0-21swapper/118:30:141
17258995220,12cyclictest0-21swapper/122:09:411
17258995218,9cyclictest17012-21cut21:24:061
1725799525,39cyclictest0-21swapper/020:59:150
1725799525,14cyclictest0-21swapper/020:52:170
1725799524,40cyclictest0-21swapper/022:19:230
17257995226,12cyclictest0-21swapper/020:00:200
17257995215,31cyclictest1419-21runrttasks20:40:260
17257995215,31cyclictest1419-21runrttasks20:40:260
105892523,42sleep10-21swapper/122:01:371
45172512,43sleep10-21swapper/120:16:361
1725999516,25cyclictest0-21swapper/218:59:112
1725999515,29cyclictest0-21swapper/219:52:422
1725999514,28cyclictest0-21swapper/219:14:152
17259995132,12cyclictest21457-21cat17:44:332
17259995130,14cyclictest0-21swapper/218:22:452
1725999513,12cyclictest0-21swapper/219:44:212
17259995117,14cyclictest0-21swapper/220:34:102
17259995117,14cyclictest0-21swapper/220:34:102
1725899515,28cyclictest0-21swapper/122:34:411
1725899514,29cyclictest0-21swapper/122:49:311
1725899514,29cyclictest0-21swapper/122:39:111
1725899514,29cyclictest0-21swapper/121:52:041
1725899514,29cyclictest0-21swapper/121:44:111
1725899514,29cyclictest0-21swapper/119:49:171
1725899514,29cyclictest0-21swapper/117:59:031
1725899514,28cyclictest0-21swapper/122:59:261
1725899514,12cyclictest0-21swapper/120:59:171
1725899513,27cyclictest0-21swapper/122:24:161
1725899513,27cyclictest0-21swapper/119:24:091
1725799514,28cyclictest0-21swapper/019:29:120
1725799514,28cyclictest0-21swapper/017:44:020
1725799514,28cyclictest0-21swapper/017:44:020
17257995127,9cyclictest23170-21latency_hist18:58:590
195952506,7sleep20-21swapper/223:04:022
17259995030,14cyclictest0-21swapper/222:04:032
17259995012,9cyclictest0-21swapper/218:34:112
1725899505,28cyclictest0-21swapper/121:16:171
1725899505,27cyclictest0-21swapper/121:35:371
1725899504,28cyclictest0-21swapper/121:04:071
1725899504,28cyclictest0-21swapper/118:39:281
1725899504,27cyclictest0-21swapper/119:29:151
17258995031,12cyclictest9602-21sed19:34:321
1725899503,27cyclictest0-21swapper/118:09:021
17258995019,13cyclictest0-21swapper/119:09:191
17258995019,13cyclictest0-21swapper/119:09:191
17258995019,13cyclictest0-21swapper/118:09:181
17258995018,15cyclictest0-21swapper/122:29:371
1725799505,37cyclictest0-21swapper/018:49:450
1725799505,28cyclictest0-21swapper/022:54:250
1725799505,27cyclictest0-21swapper/019:13:590
1725799505,27cyclictest0-21swapper/019:13:590
1725799504,28cyclictest0-21swapper/021:34:110
1725999494,27cyclictest0-21swapper/218:44:282
1725999494,26cyclictest29516-21proc_pri19:09:272
1725999494,26cyclictest29516-21proc_pri19:09:272
17259994928,14cyclictest0-21swapper/219:04:162
1725899494,30cyclictest0-21swapper/121:30:011
1725899494,29cyclictest0-21swapper/120:54:111
1725899494,29cyclictest0-21swapper/120:43:091
1725899494,29cyclictest0-21swapper/120:43:091
1725899494,28cyclictest0-21swapper/117:45:061
1725899494,27cyclictest0-21swapper/121:58:061
1725899494,27cyclictest0-21swapper/119:40:071
1725899494,27cyclictest0-21swapper/117:49:251
1725899494,26cyclictest0-21swapper/120:29:021
1725899494,26cyclictest0-21swapper/118:19:021
1725899494,25cyclictest0-21swapper/122:47:471
1725899493,28cyclictest0-21swapper/119:19:281
17258994918,13cyclictest0-21swapper/119:14:091
63002483,9sleep00-21swapper/018:22:190
1725999485,27cyclictest0-21swapper/218:00:082
1725899484,26cyclictest0-21swapper/120:19:181
1725799488,33cyclictest41ktimersoftd/018:34:100
1725799484,27cyclictest0-21swapper/018:09:270
17259994720,12cyclictest0-21swapper/217:54:202
17259994720,11cyclictest0-21swapper/218:25:132
17259994720,11cyclictest0-21swapper/218:25:132
1725899475,26cyclictest0-21swapper/118:45:161
1725899474,26cyclictest0-21swapper/118:20:111
17258994722,13cyclictest0-21swapper/119:04:161
1725799474,26cyclictest0-21swapper/019:04:090
1725799474,23cyclictest0-21swapper/019:19:110
1725999464,35cyclictest0-21swapper/217:39:222
1725999464,35cyclictest0-21swapper/217:39:222
1725899464,26cyclictest0-21swapper/118:00:081
90522453,9sleep00-21swapper/018:29:080
90522453,9sleep00-21swapper/018:29:080
1725999455,33cyclictest0-21swapper/218:09:212
1725899453,26cyclictest0-21swapper/119:02:451
17259994415,12cyclictest0-21swapper/217:39:032
17258994426,11cyclictest19450-21gltestperf18:49:191
1725899403,23cyclictest0-21swapper/117:39:031
1725799374,25cyclictest0-21swapper/017:39:030
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional