You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-15 - 17:35

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Wed Oct 15, 2025 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2230991030,6rtkit-daemon0-21swapper/308:42:441
2230991010,5rtkit-daemon0-21swapper/309:42:271
223099990,6rtkit-daemon0-21swapper/309:07:431
223099990,6rtkit-daemon0-21swapper/309:07:431
223099950,5rtkit-daemon0-21swapper/307:27:471
1407499924,29cyclictest0-21swapper/008:57:300
1407499924,27cyclictest0-21swapper/010:12:460
1407499923,43cyclictest22253-21grep07:27:360
14074999221,13cyclictest0-21swapper/004:57:360
1407499914,26cyclictest0-21swapper/005:22:540
223099900,4rtkit-daemon2229-21rtkit-daemon05:15:521
1407499904,40cyclictest0-21swapper/009:29:530
223099890,5rtkit-daemon2229-21rtkit-daemon07:28:472
1407499894,26cyclictest0-21swapper/006:22:300
14074998926,12cyclictest1265-21runrttasks09:32:340
1407499885,12cyclictest0-21swapper/010:22:000
1407499884,28cyclictest0-21swapper/007:57:150
14074998824,12cyclictest0-21swapper/005:02:480
14074998821,12cyclictest0-21swapper/008:32:420
1407499874,28cyclictest0-21swapper/005:39:020
1407499874,27cyclictest0-21swapper/009:07:300
1407499874,27cyclictest0-21swapper/009:07:300
14074998718,13cyclictest0-21swapper/007:42:400
14074998628,15cyclictest0-21swapper/007:37:070
14074998628,15cyclictest0-21swapper/007:37:070
1407499854,35cyclictest0-21swapper/006:27:420
1407499854,28cyclictest0-21swapper/007:12:480
1407499844,26cyclictest0-21swapper/005:52:490
14074998421,12cyclictest0-21swapper/009:52:460
223099830,6rtkit-daemon0-21swapper/208:18:380
223099830,6rtkit-daemon0-21swapper/208:18:380
1407499837,23cyclictest0-21swapper/005:17:210
1407499834,35cyclictest0-21swapper/005:51:070
1407499825,25cyclictest0-21swapper/006:01:180
223099810,5rtkit-daemon0-21swapper/308:29:070
223099810,5rtkit-daemon0-21swapper/307:37:320
223099810,5rtkit-daemon0-21swapper/307:37:320
1407499814,26cyclictest0-21swapper/009:02:430
1407499814,26cyclictest0-21swapper/009:02:430
1407499813,24cyclictest0-21swapper/010:07:230
14074998028,12cyclictest0-21swapper/010:22:350
223099780,6rtkit-daemon0-21swapper/310:02:340
223099770,7rtkit-daemon0-21swapper/305:19:150
223099770,6rtkit-daemon0-21swapper/308:49:510
223099770,6rtkit-daemon0-21swapper/308:12:230
223099770,6rtkit-daemon0-21swapper/308:09:150
223099770,6rtkit-daemon0-21swapper/306:03:430
223099770,5rtkit-daemon0-21swapper/306:59:180
223099770,5rtkit-daemon0-21swapper/306:59:180
223099770,5rtkit-daemon0-21swapper/305:46:140
223099770,4rtkit-daemon2229-21rtkit-daemon06:52:340
223099770,4rtkit-daemon2229-21rtkit-daemon06:52:340
223099760,6rtkit-daemon0-21swapper/308:52:210
223099760,6rtkit-daemon0-21swapper/308:00:010
223099760,5rtkit-daemon0-21swapper/307:07:400
223099760,5rtkit-daemon0-21swapper/306:17:500
223099760,4rtkit-daemon2229-21rtkit-daemon09:13:130
223099750,4rtkit-daemon2229-21rtkit-daemon08:42:220
223099750,4rtkit-daemon2229-21rtkit-daemon06:39:560
223099740,6rtkit-daemon0-21swapper/207:37:243
223099740,6rtkit-daemon0-21swapper/207:37:243
223099740,5rtkit-daemon0-21swapper/307:18:170
223099740,4rtkit-daemon2229-21rtkit-daemon08:39:440
223099740,4rtkit-daemon2229-21rtkit-daemon06:43:040
223099740,4rtkit-daemon2229-21rtkit-daemon06:08:200
281232704,58sleep30-21swapper/309:55:463
223099700,4rtkit-daemon1265-21runrttasks09:57:260
223099690,6rtkit-daemon0-21swapper/206:13:430
223099690,6rtkit-daemon0-21swapper/206:13:430
1407699685,53cyclictest0-21swapper/108:27:451
223099670,7rtkit-daemon1160-21snmpd06:51:261
223099660,6rtkit-daemon0-21swapper/209:42:490
223099660,6rtkit-daemon0-21swapper/208:05:380
223099660,6rtkit-daemon0-21swapper/207:17:483
223099660,5rtkit-daemon2229-21rtkit-daemon08:12:381
223099650,6rtkit-daemon0-21swapper/208:29:453
14076996546,12cyclictest25873-21gltestperf06:27:391
223099630,6rtkit-daemon0-21swapper/206:44:111
223099620,7rtkit-daemon0-21swapper/207:27:403
223099620,6rtkit-daemon0-21swapper/210:09:331
223099620,5rtkit-daemon0-21swapper/208:19:451
223099620,5rtkit-daemon0-21swapper/208:19:451
1407899625,50cyclictest0-21swapper/308:17:153
223099610,9rtkit-daemon0-21swapper/205:56:063
223099610,6rtkit-daemon0-21swapper/209:36:051
223099610,4rtkit-daemon2229-21rtkit-daemon05:32:520
1407899615,48cyclictest0-21swapper/306:22:473
223099600,7rtkit-daemon0-21swapper/208:37:143
14076995941,11cyclictest30607-21gltestperf06:37:381
223099580,8rtkit-daemon0-21swapper/205:02:453
223099580,5rtkit-daemon3643-21python09:02:432
223099580,5rtkit-daemon3643-21python09:02:432
223099580,5rtkit-daemon0-21swapper/206:27:343
223099580,4rtkit-daemon5916-21ntpdc06:52:412
223099580,4rtkit-daemon5916-21ntpdc06:52:412
1407899588,41cyclictest0-21swapper/310:12:263
317432574,12sleep30-21swapper/308:55:493
223352573,46sleep20-21swapper/209:42:352
223099570,6rtkit-daemon2229-21rtkit-daemon04:56:011
223099570,6rtkit-daemon0-21swapper/209:34:503
223099570,6rtkit-daemon0-21swapper/209:31:573
223099570,6rtkit-daemon0-21swapper/206:58:483
223099570,6rtkit-daemon0-21swapper/206:58:483
223099570,6rtkit-daemon0-21swapper/206:50:563
223099570,6rtkit-daemon0-21swapper/006:32:422
1407899574,46cyclictest0-21swapper/308:06:383
223099560,7rtkit-daemon0-21swapper/206:07:503
223099560,7rtkit-daemon0-21swapper/205:33:593
223099560,6rtkit-daemon0-21swapper/205:45:363
223099560,6rtkit-daemon0-21swapper/205:02:153
223099560,4rtkit-daemon10462-21irqstats07:02:410
317792552,18sleep20-21swapper/206:40:432
223099550,8rtkit-daemon0-21swapper/208:48:063
223099550,6rtkit-daemon0-21swapper/210:08:563
223099550,6rtkit-daemon0-21swapper/208:09:083
223099550,6rtkit-daemon0-21swapper/007:57:382
223099550,6rtkit-daemon0-21swapper/005:27:372
223099550,6rtkit-daemon0-21swapper/005:27:372
223099550,5rtkit-daemon0-21swapper/205:19:073
14077995530,8cyclictest11876-21telnet09:22:252
1407799553,11cyclictest0-21swapper/208:22:302
14076995512,35cyclictest16653-21munin-node07:17:311
223099540,8rtkit-daemon0-21swapper/207:52:163
223099540,5rtkit-daemon2229-21rtkit-daemon07:32:471
223099540,5rtkit-daemon2229-21rtkit-daemon07:32:471
223099540,5rtkit-daemon0-21swapper/209:12:513
223099540,5rtkit-daemon0-21swapper/206:03:353
223099540,5rtkit-daemon0-21swapper/205:47:513
223099540,4rtkit-daemon25234-21tr08:42:293
1407799543,12cyclictest0-21swapper/208:22:152
1407799543,12cyclictest0-21swapper/208:22:152
1407799543,11cyclictest0-21swapper/209:17:252
14077995428,12cyclictest0-21swapper/209:52:332
1407699545,28cyclictest14473-21fgrep06:02:491
223099530,6rtkit-daemon0-21swapper/209:17:203
223099530,6rtkit-daemon0-21swapper/207:59:533
1407899533,44cyclictest0-21swapper/306:22:193
326662523,41sleep20-21swapper/210:02:462
223099520,5rtkit-daemon2229-21rtkit-daemon05:02:231
223099520,5rtkit-daemon0-21swapper/205:22:373
223099520,4rtkit-daemon2229-21rtkit-daemon06:12:281
223099520,4rtkit-daemon2229-21rtkit-daemon06:12:281
223099520,4rtkit-daemon2229-21rtkit-daemon05:31:291
223099520,4rtkit-daemon2229-21rtkit-daemon05:31:291
14076995234,10cyclictest11549-21gltestperf05:57:411
4052512,9sleep20-21swapper/205:33:562
223099510,5rtkit-daemon2229-21rtkit-daemon08:48:441
210732512,42sleep00-21swapper/007:26:270
1407899513,26cyclictest0-21swapper/305:27:323
1407899513,26cyclictest0-21swapper/305:27:323
14077995134,11cyclictest24145-21cpuspeed_turbos05:17:392
1407699515,23cyclictest0-21swapper/107:07:291
1407699514,29cyclictest0-21swapper/108:02:431
1407499514,25cyclictest0-21swapper/009:51:550
1407499514,25cyclictest0-21swapper/009:51:550
281642502,9sleep20-21swapper/207:40:362
281642502,9sleep20-21swapper/207:40:362
210642503,9sleep10-21swapper/107:26:201
198952502,42sleep30-21swapper/306:16:173
198952502,42sleep30-21swapper/306:16:173
173862503,9sleep10-21swapper/108:25:331
1407899505,28cyclictest0-21swapper/307:32:373
1407899505,28cyclictest0-21swapper/307:32:373
1407899504,28cyclictest0-21swapper/307:42:283
1407899504,27cyclictest0-21swapper/308:37:443
1407899504,27cyclictest0-21swapper/305:12:213
14078995032,10cyclictest5366-21cut09:07:323
14078995032,10cyclictest5366-21cut09:07:323
1407899502,10cyclictest0-21swapper/308:17:273
1407899502,10cyclictest0-21swapper/308:17:273
14077995034,9cyclictest32663-21grep07:47:482
14077995034,10cyclictest28503-21needreboot08:47:372
1407699504,29cyclictest0-21swapper/107:02:441
1407699504,11cyclictest0-21swapper/109:21:511
14076995033,11cyclictest1265-21runrttasks08:36:361
14076995021,12cyclictest0-21swapper/107:37:351
14076995021,12cyclictest0-21swapper/107:37:351
14076995020,12cyclictest0-21swapper/106:37:191
1407499504,28cyclictest0-21swapper/006:32:460
14074995030,13cyclictest0-21swapper/008:22:330
14074995021,12cyclictest0-21swapper/009:22:120
137002502,43sleep00-21swapper/009:24:400
102632503,9sleep10-21swapper/110:26:591
317602493,40sleep20-21swapper/208:56:002
317502493,9sleep30-21swapper/306:40:203
232842492,9sleep30-21swapper/309:45:063
223099490,5rtkit-daemon2229-21rtkit-daemon10:12:481
1407899493,9cyclictest5974-21proc_pri06:52:423
1407899493,9cyclictest5974-21proc_pri06:52:423
14077994935,9cyclictest18150-21tr06:12:372
14077994935,9cyclictest18150-21tr06:12:372
14077994933,10cyclictest12752-21wc07:07:372
1407799493,39cyclictest0-21swapper/210:17:212
1407699498,24cyclictest0-21swapper/105:17:371
1407699495,27cyclictest0-21swapper/108:57:261
1407699494,28cyclictest0-21swapper/108:52:451
1407699494,28cyclictest0-21swapper/105:07:571
1407699494,27cyclictest0-21swapper/107:52:321
1407699494,27cyclictest0-21swapper/107:42:441
1407699494,12cyclictest0-21swapper/110:01:571
14076994931,11cyclictest1265-21runrttasks09:04:581
14076994931,11cyclictest1265-21runrttasks09:04:581
14076994920,12cyclictest0-21swapper/107:12:461
1407499494,27cyclictest0-21swapper/005:07:400
66632483,9sleep10-21swapper/106:55:331
66632483,9sleep10-21swapper/106:55:331
32072482,9sleep20-21swapper/205:41:582
1407899485,26cyclictest0-21swapper/307:12:583
1407899484,26cyclictest0-21swapper/305:57:493
1407899483,25cyclictest0-21swapper/305:37:443
1407799484,27cyclictest0-21swapper/208:57:372
14077994835,8cyclictest13351-21cpuspeed_turbos06:02:342
1407799483,27cyclictest0-21swapper/209:37:262
1407699487,23cyclictest0-21swapper/105:02:581
1407699484,27cyclictest0-21swapper/110:02:441
1407699484,27cyclictest0-21swapper/109:52:341
1407699484,27cyclictest0-21swapper/106:07:411
14076994820,12cyclictest0-21swapper/106:22:341
14076994817,11cyclictest0-21swapper/109:26:531
1407499484,27cyclictest0-21swapper/005:27:460
1407499484,27cyclictest0-21swapper/005:27:460
1407499484,12cyclictest0-21swapper/009:37:290
14074994820,12cyclictest0-21swapper/006:52:180
138572482,9sleep30-21swapper/309:26:443
76702472,9sleep30-21swapper/310:19:203
327422472,39sleep00-21swapper/007:48:030
31402472,9sleep20-21swapper/207:56:402
30352473,9sleep10-21swapper/105:39:441
223099470,4rtkit-daemon2229-21rtkit-daemon06:57:481
223099470,4rtkit-daemon2229-21rtkit-daemon06:57:481
161652473,37sleep21116-21lldpd07:14:452
1407899474,26cyclictest0-21swapper/306:42:303
1407899474,20cyclictest0-21swapper/305:12:343
14078994732,10cyclictest19335-21tr07:22:323
14078994718,12cyclictest0-21swapper/307:07:443
14078994717,9cyclictest32099-21munin-node08:57:463
14077994734,8cyclictest7319-21cpuspeed_turbos09:12:272
14077994734,8cyclictest27883-21sed05:22:542
1407799473,27cyclictest0-21swapper/205:52:312
1407799473,26cyclictest0-21swapper/207:42:402
14077994720,12cyclictest0-21swapper/209:12:122
14077994720,12cyclictest0-21swapper/209:12:122
1407699474,27cyclictest0-21swapper/109:47:401
1407699474,27cyclictest0-21swapper/109:47:401
1407699474,27cyclictest0-21swapper/105:22:511
1407699474,26cyclictest0-21swapper/106:17:581
1407699473,27cyclictest0-21swapper/109:37:341
14076994723,7cyclictest5650-21awk05:47:201
103282472,9sleep20-21swapper/208:11:552
305522462,9sleep20-21swapper/210:01:172
245932462,38sleep20-21swapper/206:25:192
243382463,9sleep10-21swapper/108:37:501
184972462,10sleep20-21swapper/209:34:532
1407899465,34cyclictest0-21swapper/306:32:323
1407899464,25cyclictest0-21swapper/309:06:483
1407899464,25cyclictest0-21swapper/309:06:483
14078994616,10cyclictest21066-21latency_hist09:42:113
1407799464,25cyclictest0-21swapper/206:07:362
14077994632,9cyclictest18355-21unixbench_singl07:17:522
1407799462,39cyclictest0-21swapper/206:47:342
1407699464,26cyclictest0-21swapper/108:11:391
14076994617,12cyclictest0-21swapper/105:52:391
140242464,6sleep00-21swapper/004:57:110
54092452,9sleep20-21swapper/210:16:002
4842453,9sleep10-21swapper/105:34:561
257562452,9sleep20-21swapper/209:50:572
257562452,9sleep20-21swapper/209:50:572
197012452,9sleep20-21swapper/208:29:332
1407899454,22cyclictest0-21swapper/308:22:273
14078994532,8cyclictest8572-21df_abs10:22:263
1407899453,21cyclictest1827-21http_loadtime07:52:353
1407799454,34cyclictest0-21swapper/207:22:402
14077994532,8cyclictest20859-21grep08:32:312
14077994520,9cyclictest24076-21grep07:32:282
14077994520,9cyclictest24076-21grep07:32:282
14077994518,12cyclictest0-21swapper/208:12:332
1407699458,30cyclictest30977-21aten2.4-expect07:47:271
1407699454,25cyclictest0-21swapper/109:31:531
1407699454,25cyclictest0-21swapper/109:12:251
1407699454,24cyclictest6490-21grep10:17:281
210112443,9sleep20-21swapper/205:09:502
1407899444,23cyclictest9441-21munin-node07:02:523
1407899443,35cyclictest23856-21wc09:47:263
1407899443,35cyclictest23856-21wc09:47:263
1407899443,21cyclictest32167-21open_inodes10:02:383
14077994431,8cyclictest17422-21fschecks_time05:02:412
1407799443,35cyclictest0-21swapper/210:12:092
1407799443,34cyclictest0-21swapper/209:27:362
1407799443,24cyclictest0-21swapper/205:47:432
14077994428,10cyclictest5632-21crond05:47:202
14077994421,9cyclictest7706-21nscd06:47:172
1407799442,36cyclictest0-21swapper/206:57:482
1407799442,36cyclictest0-21swapper/206:57:482
1407699443,22cyclictest4009-21diskstats07:57:331
112062444,32sleep20-21swapper/205:57:382
76902432,35sleep20-21swapper/208:03:412
1407899434,22cyclictest28631-21aten2.4-expect09:57:233
1407799434,33cyclictest0-21swapper/204:57:352
14077994331,7cyclictest281ktimersoftd/210:22:392
14077994321,10cyclictest0-21swapper/206:27:382
137582434,32sleep20-21swapper/204:53:472
14077994228,9cyclictest23351-21gltestperf08:37:342
14077994226,11cyclictest0-21swapper/207:02:412
14077994221,15cyclictest0-21swapper/206:17:292
1407799422,10cyclictest0-21swapper/208:42:272
14076994230,8cyclictest6145-21cpuspeed_turbos05:47:351
1407799412,34cyclictest0-21swapper/205:12:522
139242349,14sleep30-21swapper/304:55:573
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional