You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-09 - 19:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Mon Mar 09, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
522921140,4sleep35228-21df08:59:033
440021020,7sleep34399-21sed09:44:173
28560999544,44cyclictest2015-21gltestperf05:59:131
28560999541,47cyclictest31096-21gltestperf08:49:071
2856099954,26cyclictest27884-21cpuspeed_turbos11:08:541
2856099944,29cyclictest0-21swapper/110:18:571
28562999223,41cyclictest0-21swapper/209:39:392
28560999126,14cyclictest0-21swapper/108:28:491
28560999126,14cyclictest0-21swapper/108:28:491
2856099874,24cyclictest0-21swapper/107:55:391
28560998629,10cyclictest29107-21gltestperf09:34:061
28560998524,8cyclictest121850irq/46-eth010:54:151
2856099813,26cyclictest0-21swapper/109:26:091
2856099794,28cyclictest0-21swapper/107:59:021
2856099784,31cyclictest0-21swapper/110:24:251
2856099756,36cyclictest25249-21iostat11:04:031
2856099744,15cyclictest0-21swapper/108:34:001
2856099734,24cyclictest0-21swapper/110:33:481
2856099734,24cyclictest0-21swapper/110:33:481
28562997223,31cyclictest13785-21ssh09:59:062
2760427210,50sleep00-21swapper/005:44:170
28562997121,35cyclictest4952-21kworker/u8:110:14:042
317622700,5sleep3361ktimersoftd/311:14:013
317622700,5sleep3361ktimersoftd/311:14:013
28562997024,40cyclictest1247-21lldpd09:49:142
28562997017,31cyclictest19425-21ntpq09:19:132
28562996923,40cyclictest14917-21cat08:24:192
28562996923,40cyclictest14917-21cat08:24:192
28562996920,35cyclictest0-21swapper/208:02:132
28562996913,51cyclictest0-21swapper/208:50:522
2856299685,35cyclictest20332-21ssh10:57:522
28562996821,41cyclictest24207-21aten_r1power_cu11:03:522
28562996813,48cyclictest0-21swapper/209:34:572
28562996724,16cyclictest1419-21runrttasks06:24:082
28562996721,40cyclictest20719-21strings10:09:092
28562996721,40cyclictest17207-21latency10:04:092
28562996714,47cyclictest0-21swapper/210:19:062
28562996714,47cyclictest0-21swapper/208:57:122
28562996619,40cyclictest21707-21cat08:34:202
28562996617,44cyclictest0-21swapper/210:29:062
28562996617,43cyclictest1419-21runrttasks09:25:442
28562996617,33cyclictest0-21swapper/209:18:472
28562996614,34cyclictest27538-21basename06:54:032
28562996523,36cyclictest24716-21latency_hist07:53:502
28562996522,11cyclictest6007-21ssh08:59:152
28562996515,43cyclictest0-21swapper/210:42:152
28562996510,49cyclictest0-21swapper/210:35:352
28562996510,49cyclictest0-21swapper/210:35:352
2855599654,30cyclictest0-21swapper/008:04:390
248599650,5rtkit-daemon2484-21rtkit-daemon07:25:212
2856299649,49cyclictest0-21swapper/209:06:092
28562996427,12cyclictest12534-21ssh09:09:102
28562996427,12cyclictest12534-21ssh09:09:102
28562996421,37cyclictest12809-21sed07:29:102
28562996417,40cyclictest0-21swapper/208:10:002
28562996416,42cyclictest0-21swapper/208:14:072
28562996318,39cyclictest1419-21runrttasks11:09:492
28562996317,41cyclictest0-21swapper/208:06:572
28562996317,32cyclictest18572-21grep08:29:212
2856299627,49cyclictest0-21swapper/208:39:092
28562996217,40cyclictest0-21swapper/207:09:002
28562996215,31cyclictest0-21swapper/210:24:052
28562996213,32cyclictest0-21swapper/210:49:032
2855599624,41cyclictest0-21swapper/008:29:520
303812614,13sleep30-21swapper/305:49:263
2856299619,46cyclictest0-21swapper/207:58:292
28562996119,27cyclictest23628-21ssh11:02:372
28562996117,29cyclictest0-21swapper/210:44:162
28562996114,34cyclictest0-21swapper/208:19:102
28562996114,30cyclictest26111-21munin-node09:29:132
2855599614,29cyclictest0-21swapper/010:29:130
28555996122,21cyclictest1609-21wc11:18:420
28555996122,21cyclictest1609-21wc11:18:420
28562996036,18cyclictest1419-21runrttasks06:06:342
28562996018,19cyclictest1419-21runrttasks11:14:062
28562996018,19cyclictest1419-21runrttasks11:14:062
28562996018,14cyclictest0-21swapper/208:47:342
28562996013,30cyclictest0-21swapper/209:44:042
2855599604,39cyclictest0-21swapper/010:36:320
2855599604,39cyclictest0-21swapper/010:36:320
2855599604,34cyclictest0-21swapper/008:53:470
28555996019,24cyclictest1419-21runrttasks09:21:010
28562995917,22cyclictest9498-21tail09:53:582
28562995913,28cyclictest0-21swapper/207:03:522
28562995913,28cyclictest0-21swapper/207:03:522
261732593,48sleep00-21swapper/006:49:160
28562995815,38cyclictest0-21swapper/207:18:522
28562995812,39cyclictest20141-21systemd-cgroups06:38:522
305772573,48sleep00-21swapper/009:36:090
28563995741,10cyclictest2008-21gltestperf05:59:133
28562995716,36cyclictest0-21swapper/207:48:502
28562995716,36cyclictest0-21swapper/207:48:502
28562995713,37cyclictest0-21swapper/206:49:062
2856099573,13cyclictest0-21swapper/110:53:101
2855599575,30cyclictest0-21swapper/008:28:490
2855599575,30cyclictest0-21swapper/008:28:490
2855599574,36cyclictest0-21swapper/009:27:140
28555995716,24cyclictest25792-21grep07:54:080
28562995611,40cyclictest0-21swapper/205:59:042
2856099566,11cyclictest0-21swapper/109:07:551
2855599564,35cyclictest0-21swapper/010:42:550
2855599564,26cyclictest0-21swapper/008:54:210
248599560,6rtkit-daemon2484-21rtkit-daemon10:48:433
248599560,5rtkit-daemon2484-21rtkit-daemon06:44:152
28562995519,31cyclictest850-21crond05:58:532
28562995513,37cyclictest0-21swapper/206:43:522
2855599557,29cyclictest21299-21diskmemload09:04:050
2855599556,29cyclictest0-21swapper/010:58:580
2855599555,34cyclictest0-21swapper/009:09:480
2855599555,34cyclictest0-21swapper/009:09:480
2855599554,34cyclictest0-21swapper/008:47:240
2855599554,31cyclictest0-21swapper/010:03:440
2855599554,31cyclictest0-21swapper/009:29:170
2855599554,27cyclictest0-21swapper/008:43:480
28555995522,14cyclictest0-21swapper/010:04:030
28555995520,11cyclictest15406-21ntp_kernel_err10:49:080
94992543,8sleep09602-21sort09:53:590
294742543,44sleep00-21swapper/010:23:450
2856399544,43cyclictest0-21swapper/309:51:353
28562995427,18cyclictest1419-21runrttasks06:14:092
28562995427,18cyclictest1419-21runrttasks06:14:092
28562995417,32cyclictest6774-21tune2fs06:09:112
2855599546,27cyclictest0-21swapper/011:10:140
2855599545,29cyclictest0-21swapper/009:39:140
2855599545,27cyclictest0-21swapper/008:22:270
2855599544,31cyclictest0-21swapper/008:09:200
2855599544,30cyclictest0-21swapper/010:53:580
2855599544,30cyclictest0-21swapper/008:18:050
2855599544,30cyclictest0-21swapper/007:49:090
28555995421,14cyclictest0-21swapper/010:14:280
28555995421,14cyclictest0-21swapper/009:49:070
28555995410,26cyclictest0-21swapper/007:59:200
248599540,5rtkit-daemon2484-21rtkit-daemon10:38:583
244622543,44sleep00-21swapper/011:03:560
133292543,8sleep313431-21grep09:59:023
28563995323,24cyclictest0-21swapper/308:32:073
28562995330,17cyclictest17277-21runrttasks07:39:052
28562995324,23cyclictest603-21fschecks_time07:04:092
28562995313,11cyclictest11613-21gltestperf06:19:132
28562995313,11cyclictest11613-21gltestperf06:19:132
28560995338,10cyclictest11286-21head08:19:141
2855599535,29cyclictest0-21swapper/006:14:060
2855599535,29cyclictest0-21swapper/006:14:060
2855599535,28cyclictest0-21swapper/008:34:000
2855599535,28cyclictest0-21swapper/007:19:060
2855599534,29cyclictest0-21swapper/007:34:050
2855599534,29cyclictest0-21swapper/007:29:180
2855599534,28cyclictest0-21swapper/007:28:510
28555995323,12cyclictest0-21swapper/009:45:030
28555995321,14cyclictest0-21swapper/006:29:240
28555995321,12cyclictest20024-21ssh10:09:000
28555995321,12cyclictest12239-21ssh10:44:120
28555995321,12cyclictest0-21swapper/006:24:150
28555995320,13cyclictest0-21swapper/006:11:410
28555995320,12cyclictest0-21swapper/009:17:120
28555995320,10cyclictest27238-21ssh10:19:080
28555995319,13cyclictest0-21swapper/006:46:480
28555995317,12cyclictest4810-21cpu08:59:000
2856399529,9cyclictest361ktimersoftd/309:24:113
28563995233,12cyclictest0-21swapper/310:59:123
28562995230,16cyclictest1419-21runrttasks07:38:222
2856099524,28cyclictest0-21swapper/111:18:421
2856099524,28cyclictest0-21swapper/111:18:421
28560995234,10cyclictest20243-21cut10:09:031
2855599525,28cyclictest0-21swapper/007:39:070
2855599524,29cyclictest0-21swapper/006:39:230
2855599524,27cyclictest0-21swapper/007:44:060
2855599524,27cyclictest0-21swapper/007:44:060
28555995233,11cyclictest5675-21tail07:14:100
28555995221,13cyclictest0-21swapper/006:19:250
28555995221,13cyclictest0-21swapper/006:19:250
28555995221,13cyclictest0-21swapper/005:59:060
28555995218,14cyclictest0-21swapper/007:06:510
28555995217,13cyclictest0-21swapper/007:08:590
28555995217,12cyclictest0-21swapper/006:54:210
28555995216,13cyclictest0-21swapper/005:49:270
225222522,43sleep10-21swapper/106:43:491
28563995137,8cyclictest11963-21munin-node07:29:113
28563995121,8cyclictest20490-21cstates08:34:023
28562995127,17cyclictest15928-21grep06:29:062
2855599516,23cyclictest0-21swapper/006:04:100
2855599515,28cyclictest0-21swapper/005:54:150
2855599513,26cyclictest0-21swapper/006:34:150
28555995120,10cyclictest30006-21aten_r1power_fr06:59:020
28555995120,10cyclictest30006-21aten_r1power_fr06:59:020
169602512,42sleep10-21swapper/109:15:391
133412512,43sleep10-21swapper/109:09:421
133412512,43sleep10-21swapper/109:09:421
2856399505,9cyclictest0-21swapper/311:07:583
28563995035,10cyclictest4850-21needreboot06:04:173
2856399503,39cyclictest0-21swapper/310:19:203
2856399503,30cyclictest0-21swapper/309:37:283
28563995027,8cyclictest21299-21diskmemload09:54:073
28563995015,28cyclictest20598-21latency10:09:083
28562995028,14cyclictest8207-21iostat_ios07:19:122
28562995025,20cyclictest29138-21tr05:49:082
2856099504,25cyclictest0-21swapper/109:46:211
2856099504,22cyclictest0-21swapper/110:39:101
2856099503,40cyclictest1287-21snmpd06:26:441
2856099503,30cyclictest0-21swapper/106:29:131
2856099500,9cyclictest32114-21kworker/3:108:04:011
248599500,5rtkit-daemon2484-21rtkit-daemon07:52:053
248599500,4rtkit-daemon2484-21rtkit-daemon11:12:493
138962502,41sleep10-21swapper/107:31:041
305962492,9sleep10-21swapper/105:49:371
2856399495,39cyclictest0-21swapper/307:59:073
2856399492,42cyclictest0-21swapper/306:39:253
2856099494,39cyclictest0-21swapper/109:31:051
2856099494,38cyclictest0-21swapper/110:04:001
2856099494,13cyclictest0-21swapper/109:55:031
272392493,39sleep127366-21df_abs08:44:031
248599490,4rtkit-daemon2484-21rtkit-daemon07:54:043
233792493,40sleep123382-21sh11:01:431
199642493,7sleep319971-21sh10:56:333
150322493,9sleep30-21swapper/306:24:533
53402482,40sleep10-21swapper/108:10:291
2856399488,32cyclictest0-21swapper/306:44:023
2856399486,32cyclictest361ktimersoftd/308:39:023
2856399484,20cyclictest0-21swapper/308:47:183
28563994834,8cyclictest25903-21crond10:18:433
28563994832,11cyclictest0-21swapper/310:04:573
2856399483,39cyclictest21299-21diskmemload08:04:193
2856399483,38cyclictest0-21swapper/308:19:073
28563994828,13cyclictest0-21swapper/306:34:093
28563994821,12cyclictest0-21swapper/309:33:383
28563994821,12cyclictest0-21swapper/309:23:473
2856099484,39cyclictest0-21swapper/109:59:131
2856099484,27cyclictest0-21swapper/108:54:161
28560994832,10cyclictest31937-21cut09:38:591
28560994831,12cyclictest0-21swapper/108:16:461
2856099483,29cyclictest0-21swapper/110:14:151
2856099483,26cyclictest0-21swapper/108:29:091
2856099483,25cyclictest0-21swapper/106:14:051
2856099483,25cyclictest0-21swapper/106:14:051
28560994812,8cyclictest0-21swapper/109:19:181
248599480,5rtkit-daemon2484-21rtkit-daemon10:35:513
248599480,5rtkit-daemon2484-21rtkit-daemon10:35:513
92782472,38sleep30-21swapper/307:23:083
42602472,39sleep10-21swapper/107:09:561
2856399478,10cyclictest0-21swapper/308:53:093
28563994734,8cyclictest31019-21sendmail_mailst10:24:133
28563994731,10cyclictest25963-21gltestperf06:49:123
2856399473,37cyclictest0-21swapper/308:09:073
28563994722,8cyclictest8190-21latency_hist06:13:543
2856399472,38cyclictest1315-21wc07:04:203
28563994718,23cyclictest15353-21nscd08:54:053
28563994712,28cyclictest0-21swapper/308:14:183
2856099474,38cyclictest0-21swapper/109:00:171
2856099474,26cyclictest0-21swapper/107:36:561
2856099473,26cyclictest0-21swapper/109:51:441
2856399467,32cyclictest361ktimersoftd/308:24:063
2856399467,32cyclictest361ktimersoftd/308:24:063
2856399465,34cyclictest0-21swapper/309:14:133
2856399464,37cyclictest0-21swapper/309:40:423
28563994627,7cyclictest10260-21ssh09:05:453
28562994623,17cyclictest0-21swapper/205:48:552
2856099464,26cyclictest0-21swapper/105:54:201
2856099464,24cyclictest0-21swapper/110:31:401
2856099463,37cyclictest0-21swapper/110:43:591
28560994622,9cyclictest17432-21fschecks_time07:39:071
2856099462,38cyclictest0-21swapper/107:14:501
237872462,37sleep10-21swapper/106:44:131
115182462,9sleep30-21swapper/307:26:143
6072452,9sleep30-21swapper/305:55:473
2856399455,35cyclictest0-21swapper/310:31:233
28563994532,8cyclictest30672-21cut06:59:083
28563994532,8cyclictest30672-21cut06:59:083
2856399453,37cyclictest0-21swapper/307:12:423
2856399452,39cyclictest0-21swapper/310:51:293
2856099454,34cyclictest0-21swapper/108:39:201
2856099453,23cyclictest0-21swapper/107:53:391
128862452,9sleep30-21swapper/306:22:593
128862452,9sleep30-21swapper/306:22:593
2856399445,9cyclictest0-21swapper/309:13:473
2856399445,9cyclictest0-21swapper/309:13:473
2856099443,34cyclictest0-21swapper/107:23:591
28560994427,11cyclictest3968-21cut06:04:071
28560994417,9cyclictest640-21tune2fs07:04:101
174342442,36sleep30-21swapper/306:29:563
163212442,9sleep30-21swapper/307:36:303
320292432,35sleep10-21swapper/107:03:151
320292432,35sleep10-21swapper/107:03:151
28563994322,8cyclictest4924-21telnet07:14:033
28560994327,10cyclictest9334-21crond07:23:501
128692432,35sleep10-21swapper/106:22:451
128692432,35sleep10-21swapper/106:22:451
28563994218,7cyclictest10780-21cat06:18:543
28563994218,7cyclictest10780-21cat06:18:543
2856099423,35cyclictest0-21swapper/106:38:091
2856099423,33cyclictest28963-21sendmail_mailqu06:54:221
2856099423,24cyclictest0-21swapper/107:44:001
2856099423,24cyclictest0-21swapper/107:44:001
28560994228,9cyclictest7766-21tail06:09:251
269652422,34sleep10-21swapper/106:49:331
2856399416,20cyclictest121850irq/46-eth007:44:113
2856399416,20cyclictest121850irq/46-eth007:44:113
2856399415,10cyclictest0-21swapper/307:39:223
28563994125,10cyclictest28245-21fschecks_time06:54:103
2856099404,15cyclictest0-21swapper/105:48:551
2856399343,25cyclictest0-21swapper/305:48:553
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional