You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-10 - 15:09

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Fri Jul 10, 2026 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
906599993,26cyclictest9193-21grep08:40:120
9065999918,10cyclictest18367-21ssh09:40:140
906599965,22cyclictest6386-21ssh08:35:200
906599965,13cyclictest0-21swapper/010:00:080
906599955,25cyclictest0-21swapper/008:47:190
906599954,13cyclictest7819-21grep11:00:120
9065999518,12cyclictest0-21swapper/009:05:280
9067999427,60cyclictest0-21swapper/111:45:031
906599949,24cyclictest0-21swapper/011:45:050
906599948,25cyclictest0-21swapper/010:05:060
906599945,35cyclictest0-21swapper/011:35:090
906599945,35cyclictest0-21swapper/011:35:090
906599944,22cyclictest22433-21ssh09:45:270
906599944,13cyclictest0-21swapper/007:25:180
906599944,13cyclictest0-21swapper/007:25:180
9065999421,12cyclictest0-21swapper/008:55:130
906599935,32cyclictest1227-21runrttasks07:50:000
906599934,34cyclictest21561-21cpuspeed_turbos06:55:160
906599934,29cyclictest0-21swapper/011:15:070
906599934,26cyclictest0-21swapper/009:20:150
906599934,25cyclictest0-21swapper/010:51:490
906599934,25cyclictest0-21swapper/010:51:490
9065999320,13cyclictest0-21swapper/009:00:280
9065999318,21cyclictest0-21swapper/010:20:130
906599924,29cyclictest0-21swapper/010:15:350
906599924,29cyclictest0-21swapper/010:15:350
906599924,26cyclictest0-21swapper/009:29:100
906599924,13cyclictest0-21swapper/007:03:450
9065999224,15cyclictest0-21swapper/011:55:020
9065999217,14cyclictest0-21swapper/009:35:220
9065999217,14cyclictest0-21swapper/009:35:220
9065999214,22cyclictest0-21swapper/011:27:550
906599914,36cyclictest0-21swapper/009:55:290
906599914,34cyclictest0-21swapper/010:35:470
9065999118,13cyclictest0-21swapper/010:56:360
906599905,32cyclictest0-21swapper/010:40:050
906599905,26cyclictest0-21swapper/009:33:340
906599905,24cyclictest0-21swapper/010:29:290
906599904,27cyclictest0-21swapper/011:52:430
906599904,26cyclictest0-21swapper/010:12:290
906599903,37cyclictest0-21swapper/010:33:460
9065999026,11cyclictest14159-21df_abs11:10:080
9065999021,12cyclictest0-21swapper/009:15:270
906599895,26cyclictest0-21swapper/011:41:560
906599895,13cyclictest0-21swapper/011:30:560
906599894,26cyclictest0-21swapper/011:07:350
906599894,26cyclictest0-21swapper/009:10:230
906599894,25cyclictest0-21swapper/008:32:070
9065998921,23cyclictest0-21swapper/009:50:260
906599885,13cyclictest0-21swapper/006:50:150
906599884,26cyclictest0-21swapper/011:20:250
906599884,26cyclictest0-21swapper/008:52:250
906599884,26cyclictest0-21swapper/008:52:250
906599875,31cyclictest0-21swapper/010:45:030
906599874,26cyclictest0-21swapper/008:16:230
906599865,34cyclictest0-21swapper/007:44:240
9067998432,35cyclictest4032-21munin-node09:20:221
9065998426,12cyclictest909-21crond07:59:590
9067998331,33cyclictest18549-21sendmail_mailqu11:15:221
9067998328,49cyclictest0-21swapper/109:09:061
906599835,27cyclictest0-21swapper/008:20:220
906599834,26cyclictest0-21swapper/006:43:120
9067998229,45cyclictest1124-21snmpd09:14:421
9067998225,50cyclictest0-21swapper/108:40:261
9067998222,53cyclictest30153-21munin-node10:45:151
9067998133,31cyclictest13950-21cpuspeed11:10:061
9067998131,41cyclictest7887-21df09:25:111
9067998125,37cyclictest0-21swapper/108:19:231
219499810,4rtkit-daemon2193-21rtkit-daemon07:51:233
9067998035,38cyclictest1227-21runrttasks11:39:301
9067998035,38cyclictest1227-21runrttasks11:39:301
9067998033,28cyclictest31019-21munin-node10:00:091
9067998025,48cyclictest17573-21ssh09:40:061
9067998025,48cyclictest0-21swapper/110:59:411
9067998019,55cyclictest0-21swapper/109:34:561
906599804,25cyclictest0-21swapper/007:08:460
906599804,23cyclictest9285-21munin-node06:30:310
219499800,4rtkit-daemon2193-21rtkit-daemon11:17:222
9069997926,45cyclictest11167-21head11:05:123
9067997928,45cyclictest27570-21ssh09:54:571
9067997926,46cyclictest0-21swapper/110:25:221
9067997926,36cyclictest0-21swapper/108:57:521
9067997926,34cyclictest0-21swapper/111:53:271
9067997920,53cyclictest0-21swapper/111:25:031
906599794,12cyclictest0-21swapper/006:35:180
9069997822,33cyclictest14263-21telnet09:35:073
9069997822,33cyclictest14263-21telnet09:35:073
9067997833,27cyclictest19442-21df10:30:091
9067997824,46cyclictest0-21swapper/110:35:171
9067997823,35cyclictest0-21swapper/109:51:261
9067997819,53cyclictest0-21swapper/108:27:221
9067997818,53cyclictest0-21swapper/111:06:251
9069997724,47cyclictest8244-21grep11:00:203
9069997718,52cyclictest17574-21aten_r1power_cu09:40:063
9067997734,36cyclictest1227-21runrttasks09:18:251
9067997730,39cyclictest1227-21runrttasks06:53:201
9067997728,30cyclictest8752-21latency_hist08:39:581
9067997728,29cyclictest7751-21ssh10:11:501
9067997728,29cyclictest12403-21ssh10:20:051
9067997727,43cyclictest3753-21sort10:05:271
9067997727,33cyclictest0-21swapper/110:44:251
9067997726,44cyclictest0-21swapper/108:48:201
9067997721,50cyclictest0-21swapper/110:51:131
9067997721,50cyclictest0-21swapper/110:51:131
9067997721,49cyclictest10201-21awk10:15:231
9067997721,49cyclictest10201-21awk10:15:231
9069997617,52cyclictest12356-21ssh11:55:063
9067997633,35cyclictest12406-21fschecks_count11:55:071
9067997631,39cyclictest3272-21sh11:40:221
9067997624,45cyclictest0-21swapper/106:30:141
9067997612,58cyclictest0-21swapper/111:30:211
9069997526,41cyclictest31649-21kernelversion11:35:153
9069997526,41cyclictest31649-21kernelversion11:35:153
9069997513,54cyclictest0-21swapper/310:10:053
9067997529,29cyclictest0-21swapper/111:00:161
9067997527,41cyclictest0-21swapper/108:50:291
9067997527,41cyclictest0-21swapper/108:50:291
9067997514,53cyclictest0-21swapper/111:21:241
9069997423,33cyclictest18618-21ssh11:15:243
9067997424,43cyclictest1911-21runrttasks08:30:011
9069997314,51cyclictest0-21swapper/309:56:183
9069997313,53cyclictest12998-21sh09:31:383
9067997322,45cyclictest0-21swapper/109:00:351
227792730,3sleep2281ktimersoftd/208:59:582
906999726,59cyclictest0-21swapper/307:35:243
9067997223,32cyclictest0-21swapper/107:30:191
9067997223,32cyclictest0-21swapper/107:30:191
9067997222,33cyclictest0-21swapper/107:10:301
9069997128,27cyclictest31152-21grep09:10:303
9069997113,52cyclictest0-21swapper/310:16:013
9069997113,52cyclictest0-21swapper/310:16:013
9069997110,53cyclictest0-21swapper/310:01:593
9067997129,35cyclictest17651-21tail07:55:111
9067997127,28cyclictest0-21swapper/109:46:351
9067997125,39cyclictest0-21swapper/109:37:371
9067997125,39cyclictest0-21swapper/109:37:371
9067997119,47cyclictest0-21swapper/107:35:121
906999705,56cyclictest0-21swapper/307:10:123
9069997021,17cyclictest0-21swapper/307:15:263
9069997020,42cyclictest14396-21ssh11:10:113
9069997020,18cyclictest0-21swapper/308:48:123
9069997019,44cyclictest8333-21gltestperf09:25:153
9069997017,46cyclictest0-21swapper/310:39:373
9067997027,37cyclictest21211-21munin-node06:55:231
9067997023,30cyclictest0-21swapper/106:48:421
9067997023,30cyclictest0-21swapper/106:48:421
9069996924,26cyclictest5379-21munin-node09:20:223
9069996923,37cyclictest25102-21fschecks_time09:50:133
9069996921,41cyclictest0-21swapper/307:49:593
9069996921,40cyclictest5753-21rm10:56:393
9069996917,44cyclictest0-21swapper/310:05:083
9069996916,46cyclictest0-21swapper/311:43:243
9069996913,48cyclictest0-21swapper/308:35:183
9068996931,28cyclictest1853-21grep10:50:262
9068996931,28cyclictest1853-21grep10:50:262
9067996932,31cyclictest1227-21runrttasks08:09:431
9067996928,28cyclictest12572-21runrttasks07:44:521
9067996925,28cyclictest0-21swapper/108:00:111
9069996821,39cyclictest0-21swapper/308:40:183
9069996820,33cyclictest0-21swapper/310:45:113
9069996819,41cyclictest0-21swapper/309:16:333
9069996814,47cyclictest28565-21munin-node11:30:193
9067996833,29cyclictest31974-21needreboot07:15:291
9067996824,24cyclictest0-21swapper/108:20:121
9067996822,39cyclictest812-21aten2.4-expect07:20:131
9069996718,42cyclictest0-21swapper/309:47:503
9069996718,31cyclictest0-21swapper/309:06:073
9069996717,43cyclictest0-21swapper/310:34:303
9069996717,42cyclictest0-21swapper/308:55:333
9069996714,47cyclictest24586-21unixbench-2d09:00:313
9069996714,45cyclictest18731-21crond10:29:543
9067996729,25cyclictest25982-21munin-node07:05:321
9067996725,36cyclictest4219-21basename07:25:231
9067996725,36cyclictest4219-21basename07:25:231
906999669,51cyclictest0-21swapper/310:52:113
906999669,51cyclictest0-21swapper/310:52:113
9069996621,38cyclictest9379-21basename11:50:103
9069996619,40cyclictest24487-21munin-node07:00:223
9069996618,41cyclictest0-21swapper/308:30:213
9069996617,31cyclictest0-21swapper/311:48:163
9069996616,25cyclictest0-21swapper/310:39:563
9069996614,45cyclictest0-21swapper/311:28:023
9067996624,33cyclictest0-21swapper/106:40:211
9067996616,42cyclictest0-21swapper/108:10:181
9067996616,42cyclictest0-21swapper/108:10:181
906999658,49cyclictest0-21swapper/308:52:003
906999658,49cyclictest0-21swapper/308:52:003
9069996520,38cyclictest0-21swapper/308:09:593
9069996514,42cyclictest13708-21rt-features10:20:223
9069996510,49cyclictest0-21swapper/306:45:203
9069996510,49cyclictest0-21swapper/306:45:203
9067996533,26cyclictest14576-21unixbench_singl07:45:361
9067996529,29cyclictest0-21swapper/107:53:151
9069996417,30cyclictest0-21swapper/308:23:593
9067996419,39cyclictest0-21swapper/107:00:131
9069996320,36cyclictest21944-21munin-node11:20:223
9069996316,39cyclictest26061-21aten_r1power_fr07:05:153
9069996314,42cyclictest3262-21taskset07:25:113
9069996314,42cyclictest3262-21taskset07:25:113
9069996314,41cyclictest21185-21sed06:55:033
9067996317,31cyclictest0-21swapper/106:35:141
9069996220,35cyclictest25526-21perl08:10:183
9069996220,35cyclictest25526-21perl08:10:183
9069996219,35cyclictest21338-21processes08:00:303
83102623,12sleep20-21swapper/210:13:532
9069996120,33cyclictest1227-21runrttasks08:16:303
9069996118,36cyclictest0-21swapper/306:35:173
9068996111,29cyclictest0-21swapper/211:10:262
9069996016,38cyclictest14744-21sort06:40:213
906999599,44cyclictest0-21swapper/306:55:223
9069995920,33cyclictest7545-21runrttasks07:31:363
9069995920,33cyclictest7545-21runrttasks07:31:363
9068995941,10cyclictest28084-21gltestperf11:30:102
253312597,12sleep20-21swapper/208:10:172
253312597,12sleep20-21swapper/208:10:172
9069995814,37cyclictest0-21swapper/306:30:153
9067995825,26cyclictest0-21swapper/106:30:021
906899574,35cyclictest0-21swapper/210:59:022
9068995719,22cyclictest0-21swapper/208:43:182
906599573,19cyclictest8727-21grep07:35:190
9065995726,8cyclictest0-21swapper/008:29:590
9069995639,10cyclictest748-21telnet07:20:123
9069995630,19cyclictest10797-21cpuspeed_turbos07:40:153
906899564,45cyclictest0-21swapper/209:25:172
906899564,45cyclictest0-21swapper/209:09:062
906899564,44cyclictest0-21swapper/210:40:122
906899564,37cyclictest0-21swapper/210:28:452
906899564,23cyclictest0-21swapper/209:44:552
906899554,32cyclictest0-21swapper/211:24:552
9068995537,11cyclictest28731-21tr07:10:152
906599555,30cyclictest0-21swapper/006:50:020
906599555,30cyclictest0-21swapper/006:50:020
224292553,12sleep20-21swapper/209:45:272
219499550,6rtkit-daemon0-21swapper/208:25:073
906899544,43cyclictest1227-21runrttasks09:38:012
906899544,43cyclictest1227-21runrttasks09:38:012
906899544,43cyclictest0-21swapper/211:35:052
906899544,43cyclictest0-21swapper/211:35:052
906899544,43cyclictest0-21swapper/211:00:092
906899544,42cyclictest0-21swapper/208:36:372
906899544,24cyclictest0-21swapper/210:05:362
906899543,30cyclictest0-21swapper/211:45:122
9069995328,18cyclictest17944-21cpuspeed_turbos07:55:143
906899534,43cyclictest0-21swapper/209:30:302
906899534,42cyclictest0-21swapper/209:01:302
9068995335,12cyclictest0-21swapper/210:00:242
9068995332,14cyclictest0-21swapper/209:15:252
906899533,42cyclictest0-21swapper/207:55:322
9068995321,14cyclictest0-21swapper/206:45:262
9068995321,14cyclictest0-21swapper/206:45:262
9068995312,24cyclictest0-21swapper/209:52:222
89992534,6sleep00-21swapper/006:29:380
9069995222,13cyclictest0-21swapper/306:30:033
906899525,28cyclictest0-21swapper/208:05:002
906899524,42cyclictest0-21swapper/211:20:152
906899524,41cyclictest0-21swapper/210:15:292
906899524,41cyclictest0-21swapper/210:15:292
906899524,39cyclictest0-21swapper/211:40:042
906899524,29cyclictest0-21swapper/210:30:052
906899524,29cyclictest0-21swapper/208:24:592
906899524,29cyclictest0-21swapper/207:25:292
906899524,29cyclictest0-21swapper/207:25:292
906899524,28cyclictest0-21swapper/207:15:342
9068995221,13cyclictest0-21swapper/206:40:192
9068995220,14cyclictest0-21swapper/208:47:282
906599524,27cyclictest0-21swapper/008:09:570
9065995218,8cyclictest0-21swapper/008:00:130
233822523,7sleep223362-21latency_hist07:00:032
906899517,24cyclictest0-21swapper/209:55:482
906899515,39cyclictest0-21swapper/210:20:052
906899514,40cyclictest0-21swapper/210:39:512
906899514,40cyclictest0-21swapper/208:05:242
906899514,30cyclictest0-21swapper/211:55:072
906899514,29cyclictest0-21swapper/207:05:332
906899514,13cyclictest0-21swapper/208:33:532
906899513,42cyclictest0-21swapper/209:12:222
9065995121,12cyclictest0-21swapper/007:20:170
906899509,23cyclictest12-21rcu_preempt08:25:132
906899505,27cyclictest0-21swapper/209:23:422
906899504,28cyclictest0-21swapper/207:35:252
906899504,27cyclictest0-21swapper/211:50:122
906899504,26cyclictest0-21swapper/211:05:092
906599505,27cyclictest0-21swapper/007:50:240
906599504,28cyclictest0-21swapper/007:15:330
319982502,39sleep20-21swapper/210:49:122
906899495,26cyclictest0-21swapper/206:30:192
906899494,28cyclictest0-21swapper/207:50:362
906899494,27cyclictest0-21swapper/207:40:322
906899493,39cyclictest16598-21fschecks_count08:50:152
906899493,39cyclictest16598-21fschecks_count08:50:152
76242492,9sleep20-21swapper/207:32:402
76242492,9sleep20-21swapper/207:32:402
906899484,26cyclictest0-21swapper/207:45:322
906899484,26cyclictest0-21swapper/207:03:452
906899483,26cyclictest0-21swapper/206:55:032
906599484,26cyclictest0-21swapper/007:35:010
906599484,26cyclictest0-21swapper/007:35:010
9068994717,12cyclictest0-21swapper/208:15:122
906599474,25cyclictest0-21swapper/008:10:250
906599474,25cyclictest0-21swapper/008:10:250
302432472,38sleep00-21swapper/007:11:260
9068994517,12cyclictest0-21swapper/207:20:132
906899444,24cyclictest0-21swapper/206:35:142
906899383,10cyclictest0-21swapper/206:30:042
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional