You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-24 - 15:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Fri Oct 24, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3250321110,9sleep32408199cyclictest09:34:113
3250321110,9sleep32408199cyclictest09:34:113
318122990,4sleep131814-21tr05:04:081
223099910,4rtkit-daemon2229-21rtkit-daemon07:49:022
223099840,4rtkit-daemon2229-21rtkit-daemon07:42:090
223099840,4rtkit-daemon2229-21rtkit-daemon05:35:290
223099830,5rtkit-daemon2229-21rtkit-daemon07:11:260
223099820,4rtkit-daemon0-21swapper/306:16:582
223099800,4rtkit-daemon2229-21rtkit-daemon07:44:320
223099790,5rtkit-daemon2229-21rtkit-daemon10:14:042
223099790,5rtkit-daemon2229-21rtkit-daemon10:14:042
223099790,4rtkit-daemon2229-21rtkit-daemon06:59:190
223099780,8rtkit-daemon0-21swapper/208:47:523
223099770,5rtkit-daemon2229-21rtkit-daemon07:14:032
223099770,5rtkit-daemon0-21swapper/206:36:050
223099760,9rtkit-daemon0-21swapper/208:48:590
223099760,8rtkit-daemon0-21swapper/208:24:153
223099760,7rtkit-daemon0-21swapper/005:29:370
223099750,8rtkit-daemon0-21swapper/208:34:153
223099750,7rtkit-daemon0-21swapper/206:31:123
223099750,6rtkit-daemon26-21rcuc/209:23:583
223099750,6rtkit-daemon0-21swapper/207:15:333
223099740,8rtkit-daemon0-21swapper/205:03:163
223099740,6rtkit-daemon12-21rcu_preempt08:10:233
223099740,6rtkit-daemon12-21rcu_preempt08:10:233
223099740,5rtkit-daemon0-21swapper/207:33:103
223099730,6rtkit-daemon0-21swapper/209:20:513
223099730,6rtkit-daemon0-21swapper/209:16:063
223099730,5rtkit-daemon0-21swapper/208:19:233
223099720,6rtkit-daemon0-21swapper/208:31:083
223099720,6rtkit-daemon0-21swapper/207:25:183
223099720,6rtkit-daemon0-21swapper/207:25:183
223099720,6rtkit-daemon0-21swapper/206:25:273
223099720,6rtkit-daemon0-21swapper/206:17:203
223099720,5rtkit-daemon0-21swapper/208:00:463
223099720,5rtkit-daemon0-21swapper/207:36:103
223099720,5rtkit-daemon0-21swapper/205:09:083
223099720,4rtkit-daemon0-21swapper/208:03:543
223099720,4rtkit-daemon0-21swapper/206:19:583
223099710,6rtkit-daemon0-21swapper/204:56:463
223099710,6rtkit-daemon0-21swapper/204:50:093
223099710,5rtkit-daemon0-21swapper/210:16:183
223099710,5rtkit-daemon0-21swapper/210:16:183
223099710,5rtkit-daemon0-21swapper/208:40:003
223099710,5rtkit-daemon0-21swapper/208:17:013
223099710,5rtkit-daemon0-21swapper/207:53:543
223099710,5rtkit-daemon0-21swapper/207:40:253
223099710,5rtkit-daemon0-21swapper/207:19:253
223099710,5rtkit-daemon0-21swapper/206:34:573
223099710,5rtkit-daemon0-21swapper/205:04:463
223099700,5rtkit-daemon2229-21rtkit-daemon05:55:360
223099700,5rtkit-daemon0-21swapper/205:14:083
223099700,5rtkit-daemon0-21swapper/205:14:083
223099700,4rtkit-daemon0-21swapper/207:51:543
223099680,4rtkit-daemon2229-21rtkit-daemon09:29:050
223099680,4rtkit-daemon2229-21rtkit-daemon06:48:120
223099660,9rtkit-daemon0-21swapper/308:19:162
223099660,6rtkit-daemon0-21swapper/308:41:002
223099660,6rtkit-daemon0-21swapper/305:02:532
223099660,4rtkit-daemon2229-21rtkit-daemon06:49:190
223099660,13rtkit-daemon2229-21rtkit-daemon05:48:511
223099650,5rtkit-daemon10929-21latency06:34:122
24080996440,17cyclictest9461-21grep09:54:022
223099640,7rtkit-daemon0-21swapper/309:24:132
223099640,6rtkit-daemon0-21swapper/304:49:242
223099640,5rtkit-daemon9479-21gltestperf07:39:102
223099640,5rtkit-daemon4727-21gltestperf07:29:102
223099640,13rtkit-daemon2229-21rtkit-daemon08:49:071
223099630,5rtkit-daemon2229-21rtkit-daemon05:56:511
223099620,8rtkit-daemon0-21swapper/308:29:302
223099620,6rtkit-daemon0-21swapper/309:19:062
223099620,6rtkit-daemon0-21swapper/307:24:252
223099620,6rtkit-daemon0-21swapper/307:24:252
223099620,5rtkit-daemon0-21swapper/305:12:302
223099620,12rtkit-daemon2229-21rtkit-daemon07:44:541
223099620,12rtkit-daemon2229-21rtkit-daemon05:49:591
223099620,12rtkit-daemon2229-21rtkit-daemon05:30:301
223099620,12rtkit-daemon2229-21rtkit-daemon05:14:381
223099620,12rtkit-daemon2229-21rtkit-daemon05:14:381
223099610,5rtkit-daemon2229-21rtkit-daemon05:37:141
223099610,5rtkit-daemon0-21swapper/305:14:152
223099610,5rtkit-daemon0-21swapper/305:14:152
223099610,13rtkit-daemon2229-21rtkit-daemon05:48:060
223099610,12rtkit-daemon2229-21rtkit-daemon09:59:271
223099610,12rtkit-daemon2229-21rtkit-daemon09:49:271
223099610,12rtkit-daemon2229-21rtkit-daemon09:44:351
223099610,12rtkit-daemon2229-21rtkit-daemon09:29:351
223099610,12rtkit-daemon2229-21rtkit-daemon07:00:261
223099610,12rtkit-daemon2229-21rtkit-daemon06:52:111
223099610,12rtkit-daemon2229-21rtkit-daemon06:09:431
223099610,11rtkit-daemon2229-21rtkit-daemon07:42:321
324472603,12sleep00-21swapper/005:04:160
2408199603,48cyclictest0-21swapper/309:03:563
24080996025,13cyclictest0-21swapper/208:38:452
24081995927,11cyclictest15843-21telnet10:08:553
2408099595,36cyclictest0-21swapper/206:29:062
2408199583,35cyclictest65162tr09:48:563
24079995830,12cyclictest0-21swapper/107:14:021
24079995829,13cyclictest0-21swapper/110:09:111
223099580,4rtkit-daemon2229-21rtkit-daemon06:36:121
2408099577,31cyclictest0-21swapper/208:17:372
223099570,5rtkit-daemon2229-21rtkit-daemon09:39:201
223099570,13rtkit-daemon2229-21rtkit-daemon09:39:050
113512574,12sleep00-21swapper/009:59:000
223099560,5rtkit-daemon2229-21rtkit-daemon05:39:141
223099560,5rtkit-daemon19666-21python07:59:162
256602553,46sleep00-21swapper/007:04:190
24080995523,10cyclictest12727-21unixbench_singl09:59:182
223099550,5rtkit-daemon2229-21rtkit-daemon05:59:131
223099550,5rtkit-daemon2229-21rtkit-daemon05:59:131
46552543,45sleep00-21swapper/007:29:100
2408099544,31cyclictest0-21swapper/208:09:132
2408099544,31cyclictest0-21swapper/208:09:132
24079995425,13cyclictest0-21swapper/108:39:101
24077995437,10cyclictest2158-21grep07:24:070
24077995437,10cyclictest2158-21grep07:24:070
190662542,9sleep20-21swapper/209:07:552
108592543,7sleep310956-21memory08:49:103
63162533,43sleep16365-21munin-node06:24:181
304142533,9sleep00-21swapper/008:24:000
2408199534,43cyclictest0-21swapper/309:44:103
2408099535,30cyclictest0-21swapper/205:49:102
2408099534,30cyclictest0-21swapper/207:44:022
2407999534,30cyclictest0-21swapper/110:03:541
24079995320,15cyclictest0-21swapper/108:19:001
2407799539,24cyclictest9612-21sshd09:54:050
2407799535,27cyclictest0-21swapper/008:15:080
2407799534,28cyclictest1160-21snmpd09:47:530
24077995321,13cyclictest0-21swapper/006:14:140
171752533,11sleep20-21swapper/210:09:142
91142522,10sleep10-21swapper/105:24:081
76182523,9sleep00-21swapper/009:49:120
6862523,9sleep00-21swapper/009:34:450
6862523,9sleep00-21swapper/009:34:450
2408199526,40cyclictest0-21swapper/306:04:043
2408099525,28cyclictest0-21swapper/206:59:122
2408099524,30cyclictest0-21swapper/207:34:182
24080995236,9cyclictest14993-21cat10:04:152
2407999526,28cyclictest0-21swapper/109:17:471
24079995228,12cyclictest0-21swapper/105:11:151
2407799525,28cyclictest0-21swapper/010:14:180
2407799525,28cyclictest0-21swapper/010:14:180
24077995235,11cyclictest8013-21unixbench_singl07:34:210
223099520,5rtkit-daemon2229-21rtkit-daemon06:04:061
35382513,9sleep00-21swapper/005:11:500
262122513,42sleep00-21swapper/009:22:400
2408199516,39cyclictest0-21swapper/306:09:023
2408199515,40cyclictest0-21swapper/305:39:273
2408199514,42cyclictest0-21swapper/305:54:083
2408199513,42cyclictest0-21swapper/308:54:183
2408099515,27cyclictest0-21swapper/207:22:282
2408099514,28cyclictest0-21swapper/209:29:142
2408099514,28cyclictest0-21swapper/208:59:122
2408099514,28cyclictest0-21swapper/206:54:112
2408099514,27cyclictest0-21swapper/205:04:152
24080995117,14cyclictest0-21swapper/205:19:202
2407999515,29cyclictest0-21swapper/107:09:221
2407999515,28cyclictest0-21swapper/109:09:141
2407999514,29cyclictest0-21swapper/107:54:101
2407999514,29cyclictest0-21swapper/107:29:081
2407999514,29cyclictest0-21swapper/106:54:251
24079995130,14cyclictest0-21swapper/109:34:071
24079995130,14cyclictest0-21swapper/109:34:071
2407799516,21cyclictest0-21swapper/006:39:030
2407799515,28cyclictest0-21swapper/008:04:170
2407799515,28cyclictest0-21swapper/006:04:210
2407799515,28cyclictest0-21swapper/004:59:240
2407799515,27cyclictest0-21swapper/006:24:070
2407799515,27cyclictest0-21swapper/005:39:050
2407799514,28cyclictest0-21swapper/010:04:030
24077995134,9cyclictest22297-21df09:14:020
24077995131,11cyclictest12654-21df_abs08:54:030
2407799513,26cyclictest0-21swapper/006:29:040
223099510,5rtkit-daemon26676-21munin-node04:54:242
223099510,5rtkit-daemon2229-21rtkit-daemon07:07:261
223099510,5rtkit-daemon2229-21rtkit-daemon06:39:191
223099510,4rtkit-daemon2229-21rtkit-daemon05:49:140
167032513,9sleep00-21swapper/009:03:140
161362514,39sleep20-21swapper/205:39:092
2408199505,40cyclictest0-21swapper/305:29:143
2408199504,40cyclictest0-21swapper/309:54:003
2408199504,40cyclictest0-21swapper/309:29:003
2408199502,42cyclictest0-21swapper/309:39:113
2408099505,27cyclictest0-21swapper/207:54:142
2408099505,27cyclictest0-21swapper/205:47:132
2408099504,28cyclictest0-21swapper/209:12:472
2408099504,28cyclictest0-21swapper/206:43:502
2408099504,28cyclictest0-21swapper/206:07:162
2408099504,13cyclictest0-21swapper/209:14:062
24080995031,12cyclictest5532-21unixbench_multi09:44:152
2408099503,28cyclictest0-21swapper/208:24:192
2408099503,26cyclictest0-21swapper/208:54:172
24080995019,14cyclictest0-21swapper/206:47:562
24080995019,14cyclictest0-21swapper/205:27:112
2407999505,29cyclictest0-21swapper/109:28:051
2407999505,28cyclictest0-21swapper/107:58:481
2407999505,27cyclictest0-21swapper/104:54:111
2407999504,29cyclictest0-21swapper/106:29:081
2407999504,28cyclictest0-21swapper/108:14:261
2407999503,29cyclictest0-21swapper/107:49:231
24079995027,11cyclictest0-21swapper/108:59:201
24079995026,12cyclictest0-21swapper/106:19:141
2407799505,27cyclictest0-21swapper/009:09:190
2407799505,27cyclictest0-21swapper/008:39:110
2407799504,28cyclictest0-21swapper/008:19:160
2407799504,28cyclictest0-21swapper/008:09:040
2407799504,28cyclictest0-21swapper/008:09:040
2407799504,28cyclictest0-21swapper/007:14:100
2407799504,28cyclictest0-21swapper/005:14:270
2407799504,28cyclictest0-21swapper/005:14:270
2407799504,27cyclictest0-21swapper/010:09:060
24077995033,10cyclictest31070-21cut06:09:100
201482503,42sleep00-21swapper/008:00:580
190022503,41sleep00-21swapper/009:07:040
285032492,9sleep30-21swapper/307:10:313
2408199494,40cyclictest0-21swapper/306:44:023
2408199494,39cyclictest0-21swapper/305:24:053
2408099496,26cyclictest0-21swapper/207:04:112
2408099494,41cyclictest0-21swapper/207:09:242
2408099494,28cyclictest0-21swapper/208:03:592
24080994932,11cyclictest18833-21unixbench_singl06:49:232
24080994916,14cyclictest0-21swapper/209:34:142
24080994916,14cyclictest0-21swapper/209:34:142
24079994928,10cyclictest0-21swapper/104:52:051
24079994920,13cyclictest0-21swapper/108:33:591
2407799495,26cyclictest0-21swapper/008:44:090
2407799494,28cyclictest0-21swapper/005:19:240
2407799494,27cyclictest0-21swapper/007:54:030
2407799494,27cyclictest0-21swapper/007:19:160
2407799494,27cyclictest0-21swapper/006:19:150
2407799494,26cyclictest0-21swapper/006:54:120
24077994920,12cyclictest0-21swapper/009:24:150
154272492,9sleep30-21swapper/310:07:413
13832492,10sleep10-21swapper/106:14:181
129982492,9sleep30-21swapper/310:02:053
108492493,40sleep00-21swapper/005:28:430
286382483,9sleep00-21swapper/004:56:300
273462483,39sleep00-21swapper/006:00:390
273462483,39sleep00-21swapper/006:00:390
2408199484,38cyclictest0-21swapper/306:39:023
2408199484,28cyclictest0-21swapper/307:04:163
2408199483,40cyclictest26888-21sendmail_mailtr05:59:243
2408199483,40cyclictest26888-21sendmail_mailtr05:59:243
2408199483,38cyclictest1265-21runrttasks06:57:243
24081994817,25cyclictest6811-21df_abs05:19:073
2408099484,27cyclictest0-21swapper/208:49:062
2408099484,26cyclictest0-21swapper/206:24:252
2408099483,27cyclictest0-21swapper/205:29:052
2408099483,26cyclictest0-21swapper/205:54:142
2407999484,29cyclictest0-21swapper/108:29:101
2407999484,25cyclictest0-21swapper/110:13:541
2407999484,25cyclictest0-21swapper/110:13:541
2407999483,39cyclictest31175-21iostat_ios08:24:071
24079994826,10cyclictest0-21swapper/107:24:131
24079994826,10cyclictest0-21swapper/107:24:131
24079994825,11cyclictest0-21swapper/109:19:091
24079994824,12cyclictest0-21swapper/109:04:161
2407799486,36cyclictest0-21swapper/008:29:100
24077994820,12cyclictest0-21swapper/004:49:080
47882472,9sleep20-21swapper/206:23:022
44502473,9sleep00-21swapper/008:34:240
248592472,39sleep10-21swapper/108:10:061
248592472,39sleep10-21swapper/108:10:061
2408199475,35cyclictest0-21swapper/309:09:043
2408199474,39cyclictest0-21swapper/306:52:233
2408199473,38cyclictest0-21swapper/305:49:033
2408099474,26cyclictest0-21swapper/208:47:592
24080994730,10cyclictest31050-21gltestperf06:09:102
24080994729,11cyclictest13857-21cpuspeed_turbos05:34:082
2407999474,28cyclictest0-21swapper/108:44:031
24079994716,13cyclictest0-21swapper/109:57:541
238012474,6sleep00-21swapper/004:45:470
24081994628,11cyclictest0-21swapper/307:44:173
2408099464,25cyclictest0-21swapper/206:02:152
2408099464,25cyclictest0-21swapper/206:02:152
2408099464,24cyclictest0-21swapper/209:48:532
2407999465,14cyclictest0-21swapper/107:34:101
2407999464,27cyclictest0-21swapper/108:54:121
2407999464,27cyclictest0-21swapper/104:59:141
2407999464,23cyclictest0-21swapper/105:19:131
24079994616,11cyclictest0-21swapper/106:44:241
2407799464,14cyclictest0-21swapper/007:49:100
24080994524,14cyclictest0-21swapper/209:39:062
2407999454,26cyclictest0-21swapper/107:19:011
2408199444,34cyclictest0-21swapper/308:58:583
2407999444,15cyclictest0-21swapper/108:04:031
236572442,36sleep30-21swapper/306:59:353
2408199433,35cyclictest0-21swapper/305:34:053
202142432,36sleep30-21swapper/305:46:073
2408099429,9cyclictest24209-21grep04:48:562
223099340,3rtkit-daemon2229-21rtkit-daemon04:44:013
2407999305,11cyclictest0-21swapper/104:48:551
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional