You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-15 - 10:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Wed Jul 15, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
210699910937,12cyclictest16269-21if_eth022:51:011
210699910540,13cyclictest0-21swapper/119:45:571
210699910338,13cyclictest0-21swapper/121:41:181
21066998912,58cyclictest18625-21aten_r1power_cu22:55:470
21066998521,43cyclictest0-21swapper/021:18:120
2106699844,58cyclictest0-21swapper/023:31:150
2106699843,72cyclictest4872-21ssh22:35:390
2106699843,60cyclictest144601ssh23:36:010
2106699834,63cyclictest0-21swapper/023:17:300
2106699833,72cyclictest0-21swapper/023:44:270
2106699826,58cyclictest31661-21df20:51:000
2106699824,34cyclictest0-21swapper/023:21:060
2106699818,54cyclictest0-21swapper/021:30:590
2106699814,58cyclictest0-21swapper/022:41:000
21066998136,38cyclictest6224-21df21:00:590
2106699813,60cyclictest26329-21awk23:06:000
2106699813,41cyclictest22174-21ssh22:11:140
2106699804,69cyclictest0-21swapper/022:49:030
2106699804,69cyclictest0-21swapper/022:49:030
2106699804,56cyclictest0-21swapper/018:55:480
21066998038,36cyclictest24915-21grep20:41:020
21066998038,36cyclictest24915-21grep20:41:020
21066998033,40cyclictest18001-21tr19:26:010
2106699803,71cyclictest0-21swapper/020:39:270
2106699803,70cyclictest30527-21grep23:11:120
21066998016,43cyclictest9012-21ssh21:05:490
21066998010,54cyclictest0-21swapper/022:50:520
2106699794,68cyclictest0-21swapper/021:42:110
2106699794,68cyclictest0-21swapper/021:30:190
2106699794,68cyclictest0-21swapper/021:30:190
2106699794,53cyclictest0-21swapper/021:45:520
21066997932,39cyclictest25254-21grep23:51:130
2106699793,68cyclictest29832-21df_abs21:35:580
2106699793,59cyclictest13910-21sendmail_mailst21:11:130
2106699793,40cyclictest0-21swapper/022:20:550
21066997921,39cyclictest0-21swapper/020:59:080
21066997918,41cyclictest0-21swapper/022:26:560
2106699784,67cyclictest0-21swapper/022:39:580
2106699784,67cyclictest0-21swapper/019:54:000
2106699784,66cyclictest0-21swapper/023:48:470
2106699784,66cyclictest0-21swapper/021:52:400
2106699784,66cyclictest0-21swapper/019:46:000
2106699784,54cyclictest0-21swapper/021:20:570
2106699784,53cyclictest0-21swapper/022:05:590
2106699784,53cyclictest0-21swapper/022:05:590
2106699784,42cyclictest0-21swapper/022:00:050
2106699783,67cyclictest25794-21users22:16:150
21066997820,42cyclictest0-21swapper/020:32:070
2106699774,54cyclictest0-21swapper/020:48:130
2106699774,54cyclictest0-21swapper/020:48:130
2106699772,55cyclictest22440-21munin-node19:36:110
21066997717,44cyclictest0-21swapper/023:01:100
2106699764,46cyclictest0-21swapper/020:27:360
2106699763,66cyclictest0-21swapper/018:26:240
2106699763,56cyclictest66051munin-node23:25:530
2106699763,56cyclictest66051munin-node23:25:530
2106699752,58cyclictest0-21swapper/019:06:000
21066997517,41cyclictest1124-21snmpd19:41:190
21066997516,40cyclictest15395-21aten2.4-expect19:20:580
21066997516,40cyclictest15395-21aten2.4-expect19:20:580
2106699744,63cyclictest0-21swapper/018:48:070
2106699744,53cyclictest0-21swapper/020:05:460
2106699744,49cyclictest0-21swapper/019:56:060
2106699743,64cyclictest0-21swapper/022:03:020
2106699743,53cyclictest0-21swapper/018:41:000
75292730,3sleep2281ktimersoftd/221:50:542
2107199733,11cyclictest0-21swapper/222:05:522
2107199733,11cyclictest0-21swapper/222:05:522
2106699734,48cyclictest0-21swapper/020:05:580
2106699734,48cyclictest0-21swapper/020:05:580
2106699723,61cyclictest25822-21crond18:35:490
2107199713,60cyclictest0-21swapper/223:05:502
21069997138,14cyclictest0-21swapper/122:10:551
21066997127,37cyclictest10511-21head19:10:590
21069997040,11cyclictest16697-21sendmail_mailqu19:21:151
21069997040,11cyclictest16697-21sendmail_mailqu19:21:151
2106699704,59cyclictest0-21swapper/020:21:070
2106699704,59cyclictest0-21swapper/020:15:570
21066997017,38cyclictest0-21swapper/019:01:180
219499690,3rtkit-daemon2193-21rtkit-daemon20:15:343
2106999694,55cyclictest0-21swapper/123:06:021
2106699693,59cyclictest0-21swapper/018:56:090
21066996917,37cyclictest22202-21crond19:35:460
2106699684,53cyclictest0-21swapper/020:12:040
21066996822,40cyclictest14497-21timerwakeupswit19:16:210
2107199677,52cyclictest1227-21runrttasks19:06:012
2107199675,55cyclictest0-21swapper/221:26:012
2107199675,55cyclictest0-21swapper/221:26:012
2106699674,47cyclictest0-21swapper/018:36:230
2106699674,47cyclictest0-21swapper/018:36:230
21069996637,12cyclictest0-21swapper/121:30:431
2106999663,53cyclictest15558-21sort22:01:191
2106699663,55cyclictest0-21swapper/018:25:490
122912652,10sleep10-21swapper/123:32:531
2107199645,14cyclictest0-21swapper/222:15:592
21069996435,13cyclictest0-21swapper/121:06:081
219499630,4rtkit-daemon2193-21rtkit-daemon21:33:232
219499630,4rtkit-daemon2193-21rtkit-daemon21:12:542
21072996326,22cyclictest5898-21ssh23:24:023
2107199638,48cyclictest12-21rcu_preempt20:51:142
2107199635,13cyclictest0-21swapper/220:05:592
2107199635,13cyclictest0-21swapper/220:05:592
2107199634,50cyclictest8742-21ssh23:27:102
2107199634,50cyclictest8742-21ssh23:27:102
2107199634,13cyclictest0-21swapper/221:16:112
21069996334,14cyclictest0-21swapper/120:53:471
21069996332,14cyclictest0-21swapper/122:06:051
21069996332,14cyclictest0-21swapper/122:06:051
2106999633,53cyclictest0-21swapper/121:01:011
2107199623,13cyclictest0-21swapper/222:30:512
21069996238,9cyclictest8250-21crond22:40:391
21069996235,13cyclictest0-21swapper/120:33:411
21072996139,6cyclictest10253-21cat21:55:413
2107199616,48cyclictest0-21swapper/223:04:202
2107199615,48cyclictest0-21swapper/221:48:072
2107199614,50cyclictest0-21swapper/223:41:082
2107199614,13cyclictest0-21swapper/220:36:032
21069996133,13cyclictest0-21swapper/120:45:361
21069996133,13cyclictest0-21swapper/120:45:361
21069996121,20cyclictest9987-21processes22:41:101
21072996035,8cyclictest25828-21ssh23:05:533
2107199605,48cyclictest0-21swapper/222:56:002
2107199605,47cyclictest20678-21taskset21:21:152
2107199604,51cyclictest0-21swapper/220:44:482
2107199604,51cyclictest0-21swapper/220:44:482
2107199604,49cyclictest0-21swapper/222:51:042
2107199604,13cyclictest0-21swapper/220:55:592
21071996011,42cyclictest8552-21head22:40:512
21069996033,12cyclictest0-21swapper/123:13:121
21069996032,13cyclictest0-21swapper/123:26:421
21069996032,13cyclictest0-21swapper/123:26:421
21069996032,13cyclictest0-21swapper/122:46:041
21069996032,13cyclictest0-21swapper/122:46:041
21069996032,13cyclictest0-21swapper/121:54:301
21072995928,17cyclictest31397-21ssh21:37:083
2107199595,47cyclictest0-21swapper/222:11:242
2107199595,47cyclictest0-21swapper/220:47:552
2107199595,47cyclictest0-21swapper/220:47:552
2106999594,47cyclictest0-21swapper/122:29:021
21069995932,19cyclictest24555-21cut18:31:081
21069995932,13cyclictest0-21swapper/120:57:311
21069995932,12cyclictest0-21swapper/121:49:341
21069995931,13cyclictest0-21swapper/123:48:401
21069995931,13cyclictest0-21swapper/122:16:171
21072995841,10cyclictest11649-21ssh22:45:393
21072995830,10cyclictest9232-21cpu21:05:563
2107299583,49cyclictest0-21swapper/322:21:023
2107299582,50cyclictest0-21swapper/323:48:563
2107199585,46cyclictest0-21swapper/223:32:032
2107199584,49cyclictest0-21swapper/221:35:582
2107199584,47cyclictest0-21swapper/223:14:042
2107199584,11cyclictest31560-21tune2fs18:46:052
21069995834,11cyclictest0-21swapper/121:36:131
21069995832,12cyclictest0-21swapper/123:51:421
21069995830,13cyclictest0-21swapper/123:00:181
224392573,7sleep122478-21aten_r1power_en19:35:581
21072995737,14cyclictest0-21swapper/322:36:113
2107299573,48cyclictest0-21swapper/323:17:363
2107299573,48cyclictest0-21swapper/320:28:013
2107299572,50cyclictest0-21swapper/323:13:213
2107299572,50cyclictest0-21swapper/321:48:593
2107299572,50cyclictest0-21swapper/320:54:493
2107199574,46cyclictest0-21swapper/218:37:072
2107199574,46cyclictest0-21swapper/218:37:072
2107199573,48cyclictest13165-21rm22:46:062
2107199573,48cyclictest13165-21rm22:46:062
21069995733,19cyclictest0-21swapper/119:06:271
21069995732,11cyclictest0-21swapper/120:05:461
2106999573,45cyclictest15157-21latency20:26:081
219499560,6rtkit-daemon2193-21rtkit-daemon21:11:023
2107299563,47cyclictest0-21swapper/321:02:263
2107299562,49cyclictest0-21swapper/322:58:313
2107199565,15cyclictest0-21swapper/223:16:162
21071995629,9cyclictest0-21swapper/222:26:002
21069995633,10cyclictest0-21swapper/119:26:031
21069995632,10cyclictest0-21swapper/123:42:131
2106999563,47cyclictest0-21swapper/121:31:581
21069995620,14cyclictest1227-21runrttasks21:16:431
194882565,12sleep219683-21perl18:21:082
2107299553,46cyclictest0-21swapper/322:31:143
21072995529,8cyclictest27334-21telnet19:45:593
21072995521,15cyclictest0-21swapper/322:55:393
2107299552,48cyclictest0-21swapper/322:07:083
2107299552,48cyclictest0-21swapper/322:07:083
2107299552,47cyclictest0-21swapper/323:42:053
2107299552,47cyclictest0-21swapper/322:13:373
2107299552,47cyclictest0-21swapper/322:03:493
2107299552,47cyclictest0-21swapper/321:58:583
2107299552,47cyclictest0-21swapper/320:57:423
2107299552,47cyclictest0-21swapper/320:41:443
2107299552,47cyclictest0-21swapper/320:41:443
2107199554,46cyclictest0-21swapper/220:26:032
2107199554,14cyclictest0-21swapper/219:51:032
2107199554,13cyclictest0-21swapper/218:56:062
21071995521,14cyclictest0-21swapper/220:31:142
2106999555,15cyclictest0-21swapper/121:14:481
2106999554,45cyclictest0-21swapper/122:23:531
2106999554,44cyclictest0-21swapper/123:23:571
2106999554,15cyclictest0-21swapper/120:46:431
2106999554,15cyclictest0-21swapper/120:46:431
21069995539,10cyclictest20101-21which21:21:051
21069995532,11cyclictest0-21swapper/121:56:101
21069995531,11cyclictest0-21swapper/122:30:571
219499540,5rtkit-daemon2193-21rtkit-daemon19:31:203
2107299543,45cyclictest0-21swapper/323:50:483
2107299543,43cyclictest0-21swapper/322:25:553
21072995427,9cyclictest19231-21telnet21:20:563
2107299542,47cyclictest0-21swapper/321:41:533
2107299542,46cyclictest0-21swapper/321:15:503
2107299542,46cyclictest0-21swapper/320:35:463
2107199544,32cyclictest0-21swapper/222:21:112
2107199544,13cyclictest0-21swapper/221:57:032
21071995423,10cyclictest6336-21latency_hist23:25:382
21069995433,14cyclictest0-21swapper/120:36:071
21069995432,10cyclictest0-21swapper/123:37:531
21069995431,9cyclictest22815-21cpuspeed21:25:571
219499530,5rtkit-daemon2193-21rtkit-daemon19:36:053
21072995338,9cyclictest10486-21munin-node19:11:143
21072995331,8cyclictest25246-21ssh22:16:073
2107299533,45cyclictest0-21swapper/323:34:043
2107299533,45cyclictest0-21swapper/320:48:313
2107299533,45cyclictest0-21swapper/320:48:313
2107299533,24cyclictest0-21swapper/322:49:423
2107299533,24cyclictest0-21swapper/322:49:423
2107299532,46cyclictest0-21swapper/323:02:173
2107199534,43cyclictest0-21swapper/223:51:012
2107199534,13cyclictest0-21swapper/223:35:522
2107199533,8cyclictest9019-21yum-updatesd-he21:06:082
2107199533,34cyclictest0-21swapper/220:21:202
21071995324,11cyclictest8779-21sadc21:05:432
2106999535,27cyclictest0-21swapper/119:16:061
2106999535,15cyclictest0-21swapper/123:17:011
21069995332,10cyclictest0-21swapper/123:04:411
21069995324,13cyclictest0-21swapper/119:00:471
219499520,5rtkit-daemon2193-21rtkit-daemon18:57:073
21072995231,8cyclictest31753-21awk19:55:453
2107299523,44cyclictest0-21swapper/321:33:113
2107299522,46cyclictest0-21swapper/323:30:213
2107299522,46cyclictest0-21swapper/323:30:213
2107299522,45cyclictest0-21swapper/323:37:413
2107199524,29cyclictest0-21swapper/223:45:472
2107199524,27cyclictest0-21swapper/220:17:092
2107199524,12cyclictest0-21swapper/222:01:012
21071995224,9cyclictest5952-21rm22:35:592
21071995213,22cyclictest0-21swapper/221:42:562
2106999524,40cyclictest0-21swapper/119:01:011
2106999524,38cyclictest4463-21yum-updatesd-he20:05:581
2106999524,38cyclictest4463-21yum-updatesd-he20:05:581
21069995229,9cyclictest21289-21munin-node18:26:041
219499510,5rtkit-daemon2193-21rtkit-daemon20:06:043
219499510,5rtkit-daemon2193-21rtkit-daemon20:06:043
219499510,5rtkit-daemon2193-21rtkit-daemon18:41:223
21072995135,10cyclictest8094-21yum-updatesd-he19:06:093
21072995132,11cyclictest6920-21grep19:01:143
2107299512,44cyclictest0-21swapper/321:30:093
2107299512,44cyclictest0-21swapper/321:30:093
2107199514,29cyclictest0-21swapper/219:15:572
2107199514,26cyclictest0-21swapper/219:56:052
2107199513,8cyclictest6347-21tune2fs19:01:062
21071995127,14cyclictest6985-21aten2.4-expect20:10:582
21071995120,12cyclictest0-21swapper/218:26:142
2106999514,13cyclictest0-21swapper/119:31:081
21069995130,10cyclictest0-21swapper/120:12:291
21069995129,10cyclictest0-21swapper/118:45:511
21069995122,13cyclictest0-21swapper/118:36:201
21069995122,13cyclictest0-21swapper/118:36:201
2107199505,37cyclictest0-21swapper/219:43:062
2107199505,27cyclictest20644-21fschecks_count19:31:042
2107199505,26cyclictest0-21swapper/218:51:542
2107199504,27cyclictest0-21swapper/218:41:012
2107199504,12cyclictest0-21swapper/219:46:052
21071995021,11cyclictest0-21swapper/219:11:002
21071995020,12cyclictest0-21swapper/220:01:012
21069995030,13cyclictest0-21swapper/119:55:461
21069995021,13cyclictest0-21swapper/118:51:041
2107299493,40cyclictest0-21swapper/318:36:063
2107299493,40cyclictest0-21swapper/318:36:063
2107299492,41cyclictest0-21swapper/320:33:273
2107299492,41cyclictest0-21swapper/318:26:033
2107199495,28cyclictest0-21swapper/218:33:072
2107199494,28cyclictest0-21swapper/219:37:022
2106999494,27cyclictest0-21swapper/120:20:551
21069994929,9cyclictest0-21swapper/119:43:071
21069994912,20cyclictest9886-21fschecks_count20:16:041
2107299483,40cyclictest0-21swapper/320:17:043
2107299483,40cyclictest0-21swapper/319:27:013
2107299483,38cyclictest0-21swapper/320:21:143
21072994820,8cyclictest25825-21latency_hist18:35:493
2107199485,36cyclictest0-21swapper/219:25:582
2106999483,26cyclictest0-21swapper/119:57:061
219499470,5rtkit-daemon2193-21rtkit-daemon19:17:063
21072994731,10cyclictest1609-21gltestperf18:51:083
2107199473,26cyclictest0-21swapper/219:21:102
2107199473,26cyclictest0-21swapper/219:21:102
2106999474,26cyclictest0-21swapper/119:11:421
2107299462,39cyclictest0-21swapper/318:46:213
219499450,5rtkit-daemon2193-21rtkit-daemon19:41:133
2107299452,37cyclictest0-21swapper/319:55:593
2106999454,34cyclictest0-21swapper/118:41:171
2107299444,23cyclictest0-21swapper/319:20:583
2107299444,23cyclictest0-21swapper/319:20:583
2106999443,13cyclictest0-21swapper/118:25:501
219499420,4rtkit-daemon2193-21rtkit-daemon20:01:273
209862375,25sleep30-21swapper/318:25:113
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional