You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-01 - 22:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Sat Aug 01, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4037991044,49cyclictest0-21swapper/109:24:491
4035999830,8cyclictest29059-21diskmemload11:34:320
403799974,49cyclictest0-21swapper/110:00:081
4035999327,10cyclictest1124-21snmpd08:47:010
403799926,46cyclictest0-21swapper/106:39:371
403799926,46cyclictest0-21swapper/106:39:371
4035999225,12cyclictest0-21swapper/011:04:330
4035999135,13cyclictest0-21swapper/011:02:390
4035999135,13cyclictest0-21swapper/011:02:390
4035999026,13cyclictest0-21swapper/008:04:490
403599894,44cyclictest0-21swapper/009:39:420
219499890,4rtkit-daemon19892-21kworker/3:108:22:063
4035998834,14cyclictest0-21swapper/009:04:280
403599863,29cyclictest0-21swapper/007:24:410
403599863,29cyclictest0-21swapper/007:24:410
4035998627,13cyclictest0-21swapper/010:50:290
4035998619,9cyclictest381-21cat07:09:200
4035998533,12cyclictest0-21swapper/010:54:370
4035998533,10cyclictest19796-21cut06:39:490
4035998533,10cyclictest19796-21cut06:39:490
4035998526,12cyclictest0-21swapper/008:59:160
403599843,12cyclictest0-21swapper/008:16:340
4035998421,10cyclictest4573-21nscd10:09:120
4035998411,32cyclictest0-21swapper/009:19:150
4039998243,11cyclictest24812-21kworker/3:010:29:243
4039998237,22cyclictest0-21swapper/308:59:303
4039998035,40cyclictest32360-21aten2.4-expect11:29:223
4035998026,12cyclictest0-21swapper/008:50:200
4035998026,12cyclictest0-21swapper/008:50:200
4039997823,48cyclictest26945-21sh09:42:053
4039997734,25cyclictest15223-21ssh10:14:183
4039997732,22cyclictest0-21swapper/309:16:333
4039997726,45cyclictest0-21swapper/309:48:473
4039997528,29cyclictest10184-21munin-node07:29:413
4039997527,41cyclictest0-21swapper/308:38:243
4039997435,23cyclictest28683-21sensors08:54:483
4039997430,28cyclictest0-21swapper/308:16:513
4039997328,29cyclictest19860-21ntp_offset10:19:393
4039997328,29cyclictest19860-21ntp_offset10:19:393
4039997328,27cyclictest0-21swapper/311:10:113
4039997235,18cyclictest4366-21ssh11:34:333
4039997229,22cyclictest0-21swapper/308:52:223
4039997229,22cyclictest0-21swapper/308:52:223
4039997228,26cyclictest11128-21diskstats08:29:333
4039997226,28cyclictest1177-21ssh09:52:193
4039997226,27cyclictest0-21swapper/310:06:123
4039997223,32cyclictest0-21swapper/310:09:463
4039997135,29cyclictest2570-21df_abs09:54:313
4039997132,32cyclictest0-21swapper/308:24:273
4039997130,21cyclictest0-21swapper/310:02:083
4039997128,18cyclictest107550irq/46-eth011:08:193
4039997039,16cyclictest107550irq/46-eth008:39:483
4039997033,17cyclictest107550irq/46-eth010:34:223
4039997031,15cyclictest27887-21crond06:59:203
4039997028,26cyclictest0-21swapper/311:00:003
4039997028,26cyclictest0-21swapper/311:00:003
4039997028,22cyclictest107550irq/46-eth009:33:093
4039997026,12cyclictest0-21swapper/310:49:383
4039996937,10cyclictest107550irq/46-eth009:19:343
4039996931,33cyclictest0-21swapper/311:28:133
4039996930,22cyclictest0-21swapper/310:24:163
4039996927,26cyclictest0-21swapper/309:11:233
4039996925,25cyclictest0-21swapper/310:39:383
4039996923,26cyclictest0-21swapper/309:34:483
4039996923,26cyclictest0-21swapper/309:34:483
219499690,8rtkit-daemon0-21swapper/206:17:563
4039996830,19cyclictest0-21swapper/311:18:333
4039996828,24cyclictest25830-21aten2.4-expect11:19:223
4039996828,22cyclictest29531-21munin-node08:09:303
4039996828,22cyclictest29531-21munin-node08:09:303
219499680,8rtkit-daemon0-21swapper/206:39:403
219499680,8rtkit-daemon0-21swapper/206:39:403
219499680,8rtkit-daemon0-21swapper/206:31:033
219499680,8rtkit-daemon0-21swapper/206:21:263
4039996734,11cyclictest107550irq/46-eth010:44:153
4039996730,16cyclictest107550irq/46-eth010:54:263
4039996729,21cyclictest0-21swapper/309:06:323
4039996727,25cyclictest0-21swapper/307:47:153
4039996727,19cyclictest107550irq/46-eth009:24:303
4039996726,23cyclictest5504-21aten2.4-expect07:19:303
4039996723,24cyclictest0-21swapper/308:45:103
219499670,9rtkit-daemon0-21swapper/208:24:510
4039996627,32cyclictest31528-21munin-node07:04:433
4039996615,45cyclictest0-21swapper/306:36:393
4038996610,48cyclictest1227-21runrttasks10:55:422
219499660,7rtkit-daemon0-21swapper/210:49:231
219499660,7rtkit-daemon0-21swapper/110:03:022
4039996543,13cyclictest5186-21hwlatdetect06:09:433
4039996523,29cyclictest0-21swapper/307:24:323
4039996523,29cyclictest0-21swapper/307:24:323
219499650,7rtkit-daemon0-21swapper/206:24:333
4039996444,13cyclictest24279-21grep06:49:423
4039996343,14cyclictest29823-21unixbench_multi06:59:553
4039996335,21cyclictest0-21swapper/307:54:463
4039996321,20cyclictest0-21swapper/307:50:093
4038996344,13cyclictest0-21swapper/210:29:322
4038996313,42cyclictest0-21swapper/208:13:442
4038996313,42cyclictest0-21swapper/208:13:442
403799636,49cyclictest0-21swapper/109:34:401
403799636,49cyclictest0-21swapper/109:34:401
4037996226,29cyclictest31074-21munin-node09:49:381
4037996221,36cyclictest0-21swapper/107:04:421
4039996139,16cyclictest1227-21runrttasks07:59:523
4039996136,19cyclictest1002-21sshd07:39:203
4037996130,13cyclictest0-21swapper/108:49:341
4037996130,13cyclictest0-21swapper/108:49:341
4039996039,12cyclictest28015-21latency08:04:403
403899608,44cyclictest0-21swapper/209:03:022
403799605,49cyclictest0-21swapper/111:10:151
403799605,48cyclictest0-21swapper/109:19:501
219499600,6rtkit-daemon29059-21diskmemload10:10:170
4039995941,12cyclictest14722-21turbostat.cron07:39:193
4039995938,15cyclictest4742-21unixbench_multi07:14:523
403899592,51cyclictest10939-21rm10:06:202
403799595,48cyclictest0-21swapper/109:02:551
403799595,48cyclictest0-21swapper/108:36:121
403799595,47cyclictest0-21swapper/109:44:461
403799594,48cyclictest18688-21perl09:29:331
403799593,27cyclictest0-21swapper/108:19:361
4037995922,31cyclictest5698-21grep09:09:371
403899588,42cyclictest0-21swapper/209:49:142
4038995810,41cyclictest0-21swapper/210:48:382
403799586,45cyclictest3214-21grep09:54:391
403799585,46cyclictest0-21swapper/110:29:181
403799584,48cyclictest0-21swapper/110:58:441
403799584,48cyclictest0-21swapper/107:24:311
403799584,48cyclictest0-21swapper/107:24:311
403799584,47cyclictest0-21swapper/108:24:511
4035995834,9cyclictest18535-21munin-node10:19:480
4035995834,9cyclictest18535-21munin-node10:19:480
4035995833,11cyclictest5172-21crond07:19:190
4039995729,22cyclictest0-21swapper/307:12:283
403899576,44cyclictest24190-21ssh10:26:402
403899573,47cyclictest0-21swapper/211:24:382
403799577,43cyclictest1547-21nscd11:21:091
403799576,45cyclictest0-21swapper/108:30:221
403799575,46cyclictest0-21swapper/111:34:431
403799575,45cyclictest31695-21munin-node10:39:461
403799574,46cyclictest16599-21open_files10:14:401
4035995730,12cyclictest0-21swapper/009:29:480
4039995629,21cyclictest0-21swapper/306:48:533
403899569,40cyclictest0-21swapper/210:16:402
403899569,40cyclictest0-21swapper/208:57:262
403899568,41cyclictest0-21swapper/209:39:412
4038995613,12cyclictest1227-21runrttasks11:35:402
4038995611,28cyclictest1227-21runrttasks10:09:342
403799565,45cyclictest0-21swapper/111:05:161
403799565,45cyclictest0-21swapper/111:00:271
403799565,45cyclictest0-21swapper/111:00:271
403799565,45cyclictest0-21swapper/108:54:541
403599563,46cyclictest0-21swapper/009:44:360
219499560,6rtkit-daemon2193-21rtkit-daemon10:34:240
219499560,5rtkit-daemon2193-21rtkit-daemon08:09:370
219499560,5rtkit-daemon2193-21rtkit-daemon08:09:370
219499560,5rtkit-daemon2193-21rtkit-daemon07:39:380
219499560,4rtkit-daemon2193-21rtkit-daemon10:32:010
403899558,33cyclictest24478-21df_inode08:49:322
403899558,33cyclictest24478-21df_inode08:49:322
403899557,42cyclictest0-21swapper/208:35:432
403899556,42cyclictest0-21swapper/211:08:412
403899554,44cyclictest0-21swapper/208:20:342
403899554,43cyclictest17192-21ssh09:27:302
4038995538,12cyclictest0-21swapper/208:44:412
403899553,44cyclictest0-21swapper/211:29:492
403899553,13cyclictest0-21swapper/210:50:182
4038995513,10cyclictest0-21swapper/210:40:212
4038995511,38cyclictest0-21swapper/210:34:362
4038995511,36cyclictest1758-21ssh08:14:502
4038995510,38cyclictest12054-21fschecks_count09:19:342
403799556,44cyclictest0-21swapper/109:42:071
403799554,46cyclictest0-21swapper/110:28:461
403799554,45cyclictest21598-21sed10:24:121
403799554,45cyclictest21598-21sed10:24:121
403799554,45cyclictest0-21swapper/111:15:431
403799554,45cyclictest0-21swapper/110:09:461
403799554,34cyclictest0-21swapper/109:19:021
403799553,46cyclictest0-21swapper/110:37:071
403599553,45cyclictest0-21swapper/010:14:260
219499550,6rtkit-daemon2193-21rtkit-daemon07:47:300
219499550,5rtkit-daemon2193-21rtkit-daemon11:29:290
219499550,5rtkit-daemon2193-21rtkit-daemon07:59:370
219499550,5rtkit-daemon2193-21rtkit-daemon07:49:450
403899544,43cyclictest29062-21latency_hist08:09:182
403899544,43cyclictest0-21swapper/209:14:292
403899544,42cyclictest0-21swapper/209:09:492
403899543,45cyclictest0-21swapper/207:30:142
403899543,44cyclictest0-21swapper/210:21:152
403899543,44cyclictest0-21swapper/210:21:152
403899543,44cyclictest0-21swapper/207:19:442
4038995414,24cyclictest0-21swapper/209:57:092
403799545,43cyclictest1186-21awk11:29:361
403799544,44cyclictest0-21swapper/108:44:271
4037995412,26cyclictest0-21swapper/110:46:281
4035995425,13cyclictest0-21swapper/007:54:300
219499540,5rtkit-daemon2193-21rtkit-daemon07:09:390
18382544,43sleep10-21swapper/106:04:341
4039995335,12cyclictest4049-21sort06:09:233
403899535,42cyclictest0-21swapper/211:12:482
403899535,42cyclictest0-21swapper/209:30:252
403899535,12cyclictest0-21swapper/208:29:362
403899534,42cyclictest0-21swapper/207:44:182
4038995336,11cyclictest0-21swapper/206:30:232
403799535,43cyclictest0-21swapper/111:25:061
4035995331,8cyclictest31440-21idleruntime08:59:380
403599533,44cyclictest0-21swapper/008:35:000
4035995313,35cyclictest5684-21grep09:09:370
219499530,5rtkit-daemon2193-21rtkit-daemon07:34:310
403899529,28cyclictest7988-21proc_pri06:14:492
403899528,39cyclictest0-21swapper/209:49:352
403899527,31cyclictest22841-21ssh11:14:252
403899524,43cyclictest0-21swapper/211:00:162
403899524,43cyclictest0-21swapper/211:00:162
403899523,44cyclictest0-21swapper/209:07:312
403899522,44cyclictest0-21swapper/208:39:332
4038995214,31cyclictest29059-21diskmemload11:20:232
4038995212,12cyclictest0-21swapper/209:34:512
4038995212,12cyclictest0-21swapper/209:34:512
403799525,28cyclictest0-21swapper/107:39:201
219499520,5rtkit-daemon2193-21rtkit-daemon10:26:390
219499520,5rtkit-daemon2193-21rtkit-daemon07:29:310
109722523,43sleep01080-21lldpd06:21:370
85522515,39sleep00-21swapper/006:16:130
403899518,36cyclictest0-21swapper/207:44:412
4038995113,25cyclictest24264-21crond07:59:172
403799518,21cyclictest0-21swapper/107:09:331
403599515,13cyclictest0-21swapper/008:29:360
403599513,42cyclictest0-21swapper/011:09:330
403599513,42cyclictest0-21swapper/010:03:290
403599513,24cyclictest0-21swapper/006:55:070
4035995129,8cyclictest618-21ssh09:50:190
4035995125,12cyclictest0-21swapper/010:43:030
4035995121,25cyclictest0-21swapper/009:21:110
321512513,41sleep10-21swapper/108:13:461
321512513,41sleep10-21swapper/108:13:461
312262513,42sleep00-21swapper/011:26:020
219499510,5rtkit-daemon2193-21rtkit-daemon08:39:510
175462513,40sleep10-21swapper/107:44:321
403899505,39cyclictest0-21swapper/207:04:342
403899504,28cyclictest0-21swapper/207:39:192
4038995032,13cyclictest0-21swapper/206:59:492
403899503,42cyclictest0-21swapper/207:19:072
403799505,40cyclictest0-21swapper/108:17:331
4037995022,11cyclictest0-21swapper/110:07:581
4037995014,12cyclictest0-21swapper/108:04:351
403599503,30cyclictest0-21swapper/009:34:450
403599503,30cyclictest0-21swapper/009:34:450
4035995026,12cyclictest0-21swapper/010:48:420
4035995025,11cyclictest0-21swapper/006:49:440
4035995024,11cyclictest0-21swapper/009:54:290
62912493,40sleep10-21swapper/106:12:511
403899499,35cyclictest0-21swapper/206:12:012
403899498,26cyclictest0-21swapper/207:09:522
403899496,37cyclictest0-21swapper/206:48:372
403899494,40cyclictest0-21swapper/206:54:312
4038994921,12cyclictest0-21swapper/206:24:402
4038994913,19cyclictest20931-21tail07:49:432
4038994912,21cyclictest7243-21chrt08:24:302
403799495,27cyclictest0-21swapper/108:40:361
403799494,27cyclictest0-21swapper/107:17:101
4037994919,12cyclictest0-21swapper/106:59:511
403599494,39cyclictest0-21swapper/011:14:280
403599493,40cyclictest0-21swapper/011:19:240
403599493,40cyclictest0-21swapper/008:19:470
276752493,40sleep10-21swapper/106:56:361
219499490,5rtkit-daemon2193-21rtkit-daemon06:59:540
403899488,34cyclictest0-21swapper/207:59:382
403899487,12cyclictest0-21swapper/207:24:392
403899487,12cyclictest0-21swapper/207:24:392
403899485,38cyclictest0-21swapper/206:39:402
403899485,38cyclictest0-21swapper/206:39:402
4038994833,10cyclictest0-21swapper/206:09:232
403799484,26cyclictest0-21swapper/106:52:071
4037994819,13cyclictest0-21swapper/109:05:001
403599483,40cyclictest0-21swapper/009:28:390
73062475,36sleep00-21swapper/007:21:010
403899474,36cyclictest18343-21latency_hist06:39:222
403799474,26cyclictest0-21swapper/107:34:411
403799474,26cyclictest0-21swapper/106:27:031
403799474,25cyclictest0-21swapper/106:22:031
403799473,25cyclictest10613-21df07:29:351
4037994720,11cyclictest0-21swapper/107:54:391
4037994714,27cyclictest0-21swapper/107:49:301
4035994735,8cyclictest17931-21grep06:34:550
156852474,10sleep10-21swapper/106:30:531
403899464,36cyclictest0-21swapper/206:19:482
403899463,34cyclictest0-21swapper/206:49:352
403799463,8cyclictest25188-21fschecks_time07:59:371
403599463,38cyclictest0-21swapper/006:24:410
4035994628,12cyclictest0-21swapper/006:09:510
157312462,39sleep00-21swapper/006:31:280
87182453,9sleep10-21swapper/106:18:231
403799453,10cyclictest0-21swapper/106:34:371
37202453,6sleep00-21swapper/006:05:420
403799443,25cyclictest0-21swapper/107:24:201
4037994415,12cyclictest0-21swapper/106:44:481
403599444,34cyclictest0-21swapper/006:44:380
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional