You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-06 - 00:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Sun Jul 05, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2702721020,7sleep127029-21unixbench_multi08:00:151
1678699963,21cyclictest9524-21diskmemload09:34:530
1678699963,21cyclictest9524-21diskmemload09:34:530
1678699914,26cyclictest0-21swapper/008:40:490
16786999116,21cyclictest0-21swapper/009:52:590
1678699903,24cyclictest0-21swapper/010:10:350
1678699903,24cyclictest0-21swapper/010:10:350
1678699894,30cyclictest0-21swapper/008:14:410
1678699894,30cyclictest0-21swapper/008:14:410
1678699884,23cyclictest0-21swapper/011:38:210
1678699874,26cyclictest0-21swapper/009:25:080
16786998718,12cyclictest0-21swapper/006:50:310
1678699864,35cyclictest0-21swapper/010:25:190
1678699864,27cyclictest0-21swapper/011:39:550
1678699864,25cyclictest0-21swapper/009:19:530
1678699864,24cyclictest0-21swapper/009:57:140
1678699864,12cyclictest0-21swapper/011:11:580
1678699863,26cyclictest0-21swapper/007:55:020
1678699856,22cyclictest0-21swapper/010:46:280
1678699854,26cyclictest0-21swapper/011:48:090
1678699854,26cyclictest0-21swapper/008:58:340
1678699854,26cyclictest0-21swapper/008:58:340
1678699854,26cyclictest0-21swapper/007:18:000
1678699854,24cyclictest0-21swapper/010:44:300
1678699854,23cyclictest0-21swapper/008:54:030
1678699854,12cyclictest0-21swapper/011:33:290
1678699854,12cyclictest0-21swapper/011:33:290
1678699853,12cyclictest0-21swapper/009:14:280
1678999845,72cyclictest21318-21sendmail_mailqu10:25:072
1678699845,34cyclictest0-21swapper/010:02:230
1678699844,26cyclictest0-21swapper/010:15:100
1678699844,26cyclictest0-21swapper/009:30:490
1678699844,25cyclictest0-21swapper/011:19:310
1678699844,24cyclictest0-21swapper/008:45:010
1678699843,20cyclictest26084-21ssh10:33:430
1678699843,12cyclictest0-21swapper/010:58:050
1678699843,12cyclictest0-21swapper/010:58:050
1678699839,18cyclictest17549-21ssh11:55:020
1678699834,72cyclictest0-21swapper/009:45:480
1678699834,28cyclictest0-21swapper/011:04:480
1678699834,25cyclictest0-21swapper/011:50:270
1678699834,25cyclictest0-21swapper/008:38:030
1678699834,23cyclictest0-21swapper/012:02:560
1678699834,22cyclictest0-21swapper/009:17:430
1678699833,25cyclictest0-21swapper/010:09:270
219499820,4rtkit-daemon2193-21rtkit-daemon06:55:253
1678699824,26cyclictest0-21swapper/007:25:120
1678699824,24cyclictest0-21swapper/009:03:560
1678699824,22cyclictest0-21swapper/010:59:390
1678699823,25cyclictest0-21swapper/011:23:570
1678999814,69cyclictest0-21swapper/209:38:242
1678999814,69cyclictest0-21swapper/209:38:242
1678699818,22cyclictest0-21swapper/009:39:560
1678699814,33cyclictest0-21swapper/008:00:010
1678699814,24cyclictest0-21swapper/010:54:230
1678699814,24cyclictest0-21swapper/010:54:230
1678699813,33cyclictest17494-21unixbench_multi07:40:150
1678699813,33cyclictest0-21swapper/010:34:540
1678999806,67cyclictest0-21swapper/210:38:242
1678999802,32cyclictest107550irq/46-eth010:57:372
1678999802,32cyclictest107550irq/46-eth010:57:372
1678699804,33cyclictest0-21swapper/011:25:010
16786998019,12cyclictest0-21swapper/006:36:040
1678999794,69cyclictest0-21swapper/211:32:142
1678999794,69cyclictest0-21swapper/211:32:142
1678699794,33cyclictest0-21swapper/010:21:360
1678699793,38cyclictest0-21swapper/008:05:230
1678999784,56cyclictest0-21swapper/211:35:012
1678999783,67cyclictest0-21swapper/210:31:212
1678999777,64cyclictest0-21swapper/208:25:032
1678999774,68cyclictest0-21swapper/211:59:532
1678999774,68cyclictest0-21swapper/209:01:412
1678999773,68cyclictest0-21swapper/209:17:502
1678999773,48cyclictest26314-21latency_hist06:54:452
16789997716,45cyclictest0-21swapper/208:57:142
16789997716,45cyclictest0-21swapper/208:57:142
16786997723,12cyclictest0-21swapper/007:35:030
1678999767,62cyclictest2215-21gdm-simple-gree10:02:352
1678999764,66cyclictest0-21swapper/210:10:102
1678999764,66cyclictest0-21swapper/210:10:102
1678999764,66cyclictest0-21swapper/208:40:042
1678999763,33cyclictest0-21swapper/209:33:382
16789997623,46cyclictest30123-21ssh09:50:132
1678999762,66cyclictest120251ssh11:48:012
1678999757,52cyclictest0-21swapper/210:59:472
1678999755,51cyclictest21516-21telnet11:14:462
1678999754,65cyclictest0-21swapper/209:06:222
1678999754,65cyclictest0-21swapper/208:34:402
1678999754,64cyclictest0-21swapper/210:40:242
1678999754,61cyclictest30548-21df_abs08:09:572
1678999754,61cyclictest30548-21df_abs08:09:572
1678999753,51cyclictest0-21swapper/211:14:312
16789997517,52cyclictest12112-21load07:30:052
16789997517,52cyclictest12112-21load07:30:052
1678999745,63cyclictest0-21swapper/207:10:062
1678999744,64cyclictest0-21swapper/210:06:312
1678999744,64cyclictest0-21swapper/209:44:382
1678999744,51cyclictest0-21swapper/210:46:372
1678999743,64cyclictest0-21swapper/211:07:272
1678999743,63cyclictest11622-21vmstat08:35:152
1678999743,50cyclictest0-21swapper/209:26:102
1678999743,35cyclictest0-21swapper/209:58:032
1678999743,34cyclictest27831-21aten_r1power_vo08:04:542
16786997430,9cyclictest7012-21gltestperf07:20:020
1678699743,27cyclictest5838-21grep08:25:010
1678999734,52cyclictest0-21swapper/209:20:542
1678999734,49cyclictest0-21swapper/211:20:002
1678999734,36cyclictest0-21swapper/209:49:022
1678999734,35cyclictest0-21swapper/211:44:332
1678999733,63cyclictest0-21swapper/209:10:102
1678999727,47cyclictest0-21swapper/207:00:182
1678999725,60cyclictest0-21swapper/211:49:452
1678999725,59cyclictest0-21swapper/207:34:592
1678999723,61cyclictest0-21swapper/210:20:162
1678999723,48cyclictest13167-21ssh10:14:492
1678999717,58cyclictest0-21swapper/207:50:022
1678999715,60cyclictest0-21swapper/207:05:082
1678999714,62cyclictest0-21swapper/211:24:442
1678999714,47cyclictest0-21swapper/207:24:432
1678999713,61cyclictest0-21swapper/208:47:052
1678999713,45cyclictest0-21swapper/210:54:362
1678999713,45cyclictest0-21swapper/210:54:362
16789997122,31cyclictest4735-21latency_hist08:24:422
1678999693,60cyclictest0-21swapper/208:51:272
1678999693,50cyclictest0-21swapper/211:57:122
16790996818,42cyclictest18810-21rm11:58:083
1678999684,59cyclictest0-21swapper/207:54:542
1678999684,43cyclictest0-21swapper/206:35:012
1678999683,31cyclictest16561-21grep07:40:012
219499670,6rtkit-daemon0-21swapper/210:14:553
1678999674,57cyclictest0-21swapper/207:44:542
16790996620,12cyclictest16748-21runrttasks11:06:073
16790996618,41cyclictest5542-21kernelversion10:49:583
16790996618,41cyclictest5542-21kernelversion10:49:583
219499650,5rtkit-daemon2193-21rtkit-daemon08:14:443
16790996513,45cyclictest8988-21sed10:54:583
16790996513,45cyclictest8988-21sed10:54:583
1678999654,54cyclictest0-21swapper/206:40:162
1678999653,53cyclictest26551-21munin-node06:55:062
16789996526,28cyclictest21874-21aten_r1power_po06:44:572
16789996519,40cyclictest4543-21tune2fs07:14:592
1679099649,48cyclictest0-21swapper/309:30:093
1678999643,52cyclictest8746-21aten2.4-expect07:24:562
16790996322,35cyclictest15732-21ssh11:54:143
16790996318,38cyclictest0-21swapper/311:29:513
16790996318,38cyclictest0-21swapper/311:29:513
16790996313,44cyclictest0-21swapper/310:41:343
1678999634,53cyclictest0-21swapper/208:04:412
16789996322,33cyclictest0-21swapper/208:14:522
219499620,4rtkit-daemon2193-21rtkit-daemon11:45:361
1679099629,47cyclictest0-21swapper/309:55:173
16790996218,37cyclictest10404-21runrttasks07:25:233
16790996217,15cyclictest0-21swapper/311:17:583
1678899623,42cyclictest0-21swapper/111:25:451
219499610,6rtkit-daemon2193-21rtkit-daemon09:11:423
16790996120,35cyclictest21097-21grep10:25:033
16790996117,37cyclictest9615-21latency_hist10:09:373
16790996115,39cyclictest30803-21fschecks_time08:10:003
16790996115,39cyclictest30803-21fschecks_time08:10:003
16790996111,44cyclictest0-21swapper/311:11:443
1679099608,45cyclictest0-21swapper/309:42:083
16790996020,33cyclictest17943-21fgrep10:20:063
16790996019,34cyclictest28189-21cut11:24:453
16790996018,36cyclictest13479-21df08:39:553
16790996016,36cyclictest28936-21munin-node07:00:123
16790996014,40cyclictest0-21swapper/309:34:503
16790996014,40cyclictest0-21swapper/309:34:503
16790996014,40cyclictest0-21swapper/309:01:183
16790996011,41cyclictest39601ssh10:48:493
1679099599,44cyclictest1547-21nscd08:45:073
1679099599,44cyclictest0-21swapper/309:25:463
1679099598,44cyclictest4106-21memory10:00:013
16790995922,30cyclictest24906-21munin-node08:55:083
16790995922,30cyclictest24906-21munin-node08:55:083
16790995922,17cyclictest1227-21runrttasks11:19:563
16790995918,34cyclictest27008-21vmstat09:45:133
16790995918,34cyclictest13405-21telnet07:34:533
16790995918,12cyclictest22472-21runrttasks08:51:533
16790995916,36cyclictest31872-21sendmail_mailqu09:05:083
16790995914,15cyclictest0-21swapper/309:19:383
1678899594,38cyclictest0-21swapper/111:44:061
16788995911,29cyclictest0-21swapper/109:14:531
1679099588,44cyclictest0-21swapper/310:09:383
1679099588,44cyclictest0-21swapper/310:09:383
1679099588,42cyclictest0-21swapper/311:35:473
16790995822,14cyclictest10076-21perl11:44:503
16790995818,33cyclictest29812-21munin-node09:50:073
16790995815,36cyclictest9905-21aten2.4-expect08:34:523
16790995814,36cyclictest15786-21head07:39:523
16790995813,37cyclictest6814-21gltestperf11:39:523
16790995812,39cyclictest1227-21runrttasks07:32:253
16790995812,39cyclictest1227-21runrttasks07:32:253
16790995810,43cyclictest0-21swapper/311:04:083
1678899585,36cyclictest0-21swapper/111:19:361
1678899584,35cyclictest0-21swapper/108:52:061
1678899584,33cyclictest0-21swapper/110:05:171
1678899583,40cyclictest0-21swapper/110:00:041
16788995819,10cyclictest22575-21munin-run12:04:321
99342574,45sleep10-21swapper/109:20:131
16790995715,34cyclictest4967-21munin-node08:25:093
16790995714,37cyclictest0-21swapper/309:20:073
16790995713,37cyclictest1227-21runrttasks10:39:223
16790995712,38cyclictest24671-21processes10:30:053
1678899575,31cyclictest0-21swapper/110:14:371
1678899575,31cyclictest0-21swapper/110:14:371
1678899574,36cyclictest0-21swapper/111:15:281
1678899574,36cyclictest0-21swapper/110:51:381
1678899574,36cyclictest0-21swapper/110:51:381
1678899574,36cyclictest0-21swapper/110:42:361
1678899574,35cyclictest0-21swapper/111:30:051
1678899574,35cyclictest0-21swapper/111:30:051
16788995732,8cyclictest107550irq/46-eth011:55:061
1678899573,36cyclictest1124-21snmpd09:38:411
1678899573,36cyclictest1124-21snmpd09:38:411
16788995716,23cyclictest1896-21df_abs09:09:541
16788995713,21cyclictest15071-21df_abs11:04:481
1678699575,29cyclictest0-21swapper/007:29:540
1678699575,29cyclictest0-21swapper/007:29:540
219499560,5rtkit-daemon2193-21rtkit-daemon11:14:221
16790995618,11cyclictest8722-21proc_pri08:30:103
1678899565,13cyclictest0-21swapper/109:07:031
16788995621,10cyclictest23508-21entropy07:54:591
16788995617,23cyclictest0-21swapper/108:56:361
16788995617,23cyclictest0-21swapper/108:56:361
16788995612,26cyclictest0-21swapper/110:20:341
43872554,43sleep10-21swapper/108:20:191
219499550,4rtkit-daemon2193-21rtkit-daemon11:49:361
1679099558,40cyclictest19531-21stty11:59:433
16790995514,34cyclictest1227-21runrttasks07:44:543
16789995522,28cyclictest0-21swapper/206:34:462
1678899555,30cyclictest0-21swapper/109:54:591
1678899555,30cyclictest0-21swapper/108:44:391
1678899554,35cyclictest0-21swapper/109:27:011
1678899554,30cyclictest0-21swapper/110:44:511
1678899554,30cyclictest0-21swapper/108:59:521
1678899554,28cyclictest0-21swapper/109:46:281
1678899553,36cyclictest0-21swapper/110:14:591
1678899553,35cyclictest15953-21munin-node09:29:591
16788995521,13cyclictest0-21swapper/107:05:041
16788995520,13cyclictest20284-21df10:24:531
16788995517,22cyclictest0-21swapper/108:47:471
16788995513,25cyclictest0-21swapper/108:37:401
219499540,6rtkit-daemon2193-21rtkit-daemon08:00:153
219499540,5rtkit-daemon2193-21rtkit-daemon06:45:183
1679099546,41cyclictest0-21swapper/306:44:443
16790995418,30cyclictest1227-21runrttasks07:12:383
1678899549,27cyclictest0-21swapper/110:34:411
1678899547,27cyclictest0-21swapper/106:50:131
1678899546,29cyclictest0-21swapper/111:00:001
1678899545,28cyclictest0-21swapper/107:49:011
1678899544,30cyclictest0-21swapper/107:30:121
1678899544,30cyclictest0-21swapper/107:30:121
1678899544,30cyclictest0-21swapper/106:55:021
1678899544,29cyclictest0-21swapper/107:50:041
1678899544,28cyclictest0-21swapper/108:30:091
1678899544,26cyclictest0-21swapper/106:44:451
16788995438,9cyclictest30837-21cut08:10:001
16788995438,9cyclictest30837-21cut08:10:001
1678899543,25cyclictest3369-21fschecks_time11:34:541
16788995422,10cyclictest8777-21diskmemload10:54:551
16788995422,10cyclictest8777-21diskmemload10:54:551
16788995421,13cyclictest0-21swapper/107:15:041
16788995420,13cyclictest0-21swapper/107:39:001
16788995420,13cyclictest0-21swapper/107:28:591
219499530,5rtkit-daemon2193-21rtkit-daemon07:49:533
1678899536,29cyclictest0-21swapper/110:29:561
1678899535,29cyclictest0-21swapper/108:14:581
1678899535,28cyclictest0-21swapper/107:20:051
1678899535,27cyclictest0-21swapper/107:14:001
1678899534,26cyclictest0-21swapper/109:49:591
1678899534,26cyclictest0-21swapper/109:39:421
1678699534,43cyclictest0-21swapper/009:08:150
1678899525,28cyclictest0-21swapper/107:02:011
1678899525,27cyclictest0-21swapper/106:38:501
1678899524,25cyclictest0-21swapper/108:09:041
1678899523,26cyclictest0-21swapper/107:39:521
16790995116,28cyclictest1227-21runrttasks07:57:403
16786995135,9cyclictest19038-21gltestperf07:45:010
1679099507,36cyclictest0-21swapper/307:09:433
16790995012,15cyclictest3810-21munin-node07:15:023
16790995011,32cyclictest19212-21cat06:39:453
1678899503,32cyclictest4967-21munin-node08:25:121
35592492,39sleep00-21swapper/007:14:370
219499480,4rtkit-daemon2193-21rtkit-daemon06:30:183
16790994714,15cyclictest29145-21python08:05:123
1678699474,36cyclictest0-21swapper/006:40:010
16790994628,13cyclictest8262-21runrttasks07:23:363
16790994626,13cyclictest2923-21cpuspeed_turbos08:19:553
16790994618,22cyclictest26005-21runrttasks06:50:463
1678899463,27cyclictest0-21swapper/106:45:091
16786994630,10cyclictest8120-21tune2fs08:30:000
1678699463,26cyclictest0-21swapper/006:54:550
16786994626,12cyclictest1547-21nscd06:34:450
9632453,35sleep00-21swapper/007:08:490
288562453,36sleep00-21swapper/006:59:460
1678699454,23cyclictest0-21swapper/008:19:520
1678699453,24cyclictest0-21swapper/008:14:530
16786994429,9cyclictest21282-21tune2fs07:49:590
16786994331,8cyclictest22606-21gltestperf06:45:040
1678899364,13cyclictest0-21swapper/106:34:451
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional