You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-06 - 02:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Sat Dec 06, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
243799980,6rtkit-daemon0-21swapper/319:01:113
243799980,5rtkit-daemon0-21swapper/323:37:523
243799970,5rtkit-daemon0-21swapper/300:01:223
243799960,6rtkit-daemon0-21swapper/322:26:553
243799960,5rtkit-daemon0-21swapper/323:23:383
243799950,6rtkit-daemon0-21swapper/323:49:523
243799950,6rtkit-daemon0-21swapper/323:49:523
243799950,5rtkit-daemon37-21ksoftirqd/300:13:143
243799950,5rtkit-daemon0-21swapper/318:54:193
243799950,3rtkit-daemon0-21swapper/318:56:183
243799950,3rtkit-daemon0-21swapper/318:56:183
243799940,6rtkit-daemon0-21swapper/300:10:443
2270699923,81cyclictest1618-21nscd23:05:580
22706998630,49cyclictest16047-21cpuspeed_turbos20:46:170
22706998528,51cyclictest4590-21sed20:21:210
22706998414,12cyclictest22685-21idleruntime-cro18:46:080
22706998228,10cyclictest24397-21cpuspeed_turbos19:56:200
22706998227,8cyclictest4239-21unixbench_singl21:26:350
22706998224,7cyclictest1369-21runrttasks21:02:240
22706998224,7cyclictest1369-21runrttasks21:02:240
22706998223,10cyclictest9616-21taskset20:31:290
243799810,26rtkit-daemon0-21swapper/223:51:293
243799810,26rtkit-daemon0-21swapper/223:41:303
2270699814,8cyclictest6969-21gltestperf20:26:250
2270699814,70cyclictest0-21swapper/020:51:200
22706998134,39cyclictest26937-21grep21:06:360
2270699813,31cyclictest0-21swapper/022:31:580
2270699813,12cyclictest0-21swapper/020:56:360
2270699813,12cyclictest0-21swapper/019:46:260
22706998114,19cyclictest31555-21cpuspeed_turbos20:11:180
2270699803,25cyclictest0-21swapper/019:16:410
2270699803,24cyclictest7541-21tr23:51:100
22706998025,48cyclictest0-21swapper/020:36:240
22706998023,11cyclictest30907-21grep19:01:260
2270699794,12cyclictest0-21swapper/023:56:190
22706997918,12cyclictest24133-21grep18:46:330
2270699784,29cyclictest0-21swapper/000:11:110
2270699784,25cyclictest0-21swapper/020:41:360
2270699784,12cyclictest0-21swapper/022:26:340
2270699784,12cyclictest0-21swapper/021:41:210
2270699784,12cyclictest0-21swapper/021:41:210
2270699783,12cyclictest0-21swapper/019:51:180
22706997821,10cyclictest15333-21tail19:36:260
22706997821,10cyclictest15333-21tail19:36:260
22706997820,10cyclictest1618-21nscd22:10:590
2270699774,8cyclictest1369-21runrttasks21:40:460
2270699774,11cyclictest0-21swapper/023:16:290
22706997732,39cyclictest13741-21grep00:01:320
2270699773,32cyclictest0-21swapper/021:56:260
2270699773,32cyclictest0-21swapper/021:31:190
2270699773,30cyclictest0-21swapper/021:56:010
2270699773,30cyclictest0-21swapper/019:22:110
2270699773,27cyclictest13260-21grep21:46:280
2270699773,24cyclictest0-21swapper/019:11:260
2270699773,11cyclictest0-21swapper/019:08:100
22706997724,9cyclictest28092-21grep22:16:360
22706997724,7cyclictest1369-21runrttasks22:44:110
22706997724,10cyclictest0-21swapper/020:16:210
22706997721,8cyclictest25177-21telnet23:21:090
22706997714,10cyclictest0-21swapper/022:51:110
108802770,5sleep110882-21aten2.4-expect22:51:111
2270699763,8cyclictest22171-21chrt23:11:330
22706997523,8cyclictest1369-21runrttasks22:39:310
22706997513,17cyclictest0-21swapper/022:21:110
2270699744,14cyclictest0-21swapper/021:21:360
22706997424,10cyclictest19185-21strings23:06:230
22706997424,10cyclictest19185-21strings23:06:230
22706997422,8cyclictest30927-21hwlatdetect21:16:210
22706997422,7cyclictest31006-21munin-run20:11:040
2270699734,10cyclictest0-21swapper/019:31:210
2270699733,19cyclictest0-21swapper/019:28:500
22706997323,7cyclictest27786-21cpu21:11:160
22706997321,8cyclictest14758-21cstates00:06:120
22706997224,9cyclictest0-21swapper/022:46:280
22706997219,8cyclictest27557-21aten2.4-expect23:26:070
22706997216,8cyclictest25445-21python22:11:320
2270699715,14cyclictest0-21swapper/023:41:240
2270699714,28cyclictest0-21swapper/020:02:360
2270699713,29cyclictest0-21swapper/023:46:270
2270699713,29cyclictest0-21swapper/023:46:270
22706997121,8cyclictest30726-21gltestperf23:31:180
22706997121,8cyclictest1084-21needreboot23:36:230
2270699704,28cyclictest0-21swapper/019:01:080
2270699704,28cyclictest0-21swapper/019:01:080
2270699693,8cyclictest19269-21aten_r1power_en22:01:150
22706996925,11cyclictest0-21swapper/022:56:280
2270699683,31cyclictest0-21swapper/019:41:160
22712996411,31cyclictest0-21swapper/321:46:013
22712996411,31cyclictest0-21swapper/321:46:013
2271099643,55cyclictest0-21swapper/100:03:371
2271199623,50cyclictest4290-21grep19:11:402
2271199623,40cyclictest0-21swapper/223:25:572
2270699623,10cyclictest0-21swapper/018:51:200
185962603,49sleep10-21swapper/120:51:211
24102594,47sleep20-21swapper/222:31:262
22712995838,13cyclictest2806-21cpuspeed_turbos21:26:153
22712995838,12cyclictest18844-21gltestperf23:06:173
22712995838,12cyclictest18844-21gltestperf23:06:173
2271099573,48cyclictest0-21swapper/123:56:071
2271099573,47cyclictest0-21swapper/121:51:151
211092573,45sleep20-21swapper/220:56:222
27112564,7sleep10-21swapper/121:26:151
22712995638,11cyclictest6415-21cpuspeed_turbos20:26:193
22712995611,19cyclictest13021-21yum-updatesd-he20:41:013
2271199564,36cyclictest0-21swapper/221:37:542
22711995631,19cyclictest5159-21grep23:46:102
22711995631,19cyclictest5159-21grep23:46:102
2271099563,46cyclictest0-21swapper/100:06:171
40192553,8sleep34082-21switchtime19:11:383
234622550,7sleep123466-21df_abs18:46:241
22712995536,11cyclictest9538-21date21:41:023
22710995523,13cyclictest0-21swapper/119:31:161
306602542,9sleep30-21swapper/320:06:453
2271199543,44cyclictest29726-21grep20:06:272
2271199543,24cyclictest0-21swapper/220:31:232
22711995422,9cyclictest15917-21sendmail_mailqu19:36:362
22711995422,9cyclictest15917-21sendmail_mailqu19:36:362
22711995412,25cyclictest30916-21crond22:25:592
2271099545,29cyclictest0-21swapper/119:56:161
2271099543,46cyclictest0-21swapper/122:16:151
2271099543,44cyclictest1886-21chrt19:06:481
2271099543,44cyclictest0-21swapper/122:11:171
2271099543,44cyclictest0-21swapper/120:36:181
2271099543,42cyclictest0-21swapper/123:41:251
2271099542,46cyclictest0-21swapper/120:11:191
2271099542,43cyclictest0-21swapper/120:26:191
67352533,11sleep10-21swapper/121:32:161
271982534,43sleep10-21swapper/121:08:381
2271299534,29cyclictest11747-21hwlatdetect22:51:203
22712995315,21cyclictest0-21swapper/321:21:283
2271199534,25cyclictest0-21swapper/223:51:092
22711995337,10cyclictest2535-21chrt20:16:302
2271199533,30cyclictest0-21swapper/222:41:002
2271199533,29cyclictest0-21swapper/222:46:322
2271199532,45cyclictest0-21swapper/222:16:372
2271099534,30cyclictest0-21swapper/118:56:361
2271099534,30cyclictest0-21swapper/118:56:361
2271099533,45cyclictest0-21swapper/100:11:081
2271099533,43cyclictest0-21swapper/123:26:241
2271099533,43cyclictest0-21swapper/120:56:261
2271099533,41cyclictest0-21swapper/123:01:151
56862524,41sleep10-21swapper/120:23:441
56782523,13sleep30-21swapper/319:16:263
2271299524,41cyclictest0-21swapper/323:01:343
2271299524,27cyclictest12152-21aten2.4-expect21:46:153
22712995221,13cyclictest0-21swapper/320:16:393
2271199524,31cyclictest0-21swapper/223:36:182
2271199524,30cyclictest0-21swapper/218:51:322
22711995221,13cyclictest0-21swapper/220:21:252
2271099525,28cyclictest0-21swapper/122:31:321
2271099524,29cyclictest0-21swapper/120:31:261
2271099524,29cyclictest0-21swapper/119:11:271
22710995234,11cyclictest27296-21crond23:25:561
2271099523,43cyclictest0-21swapper/122:01:271
2271099523,43cyclictest0-21swapper/119:36:191
2271099523,43cyclictest0-21swapper/119:36:191
2271099523,42cyclictest0-21swapper/123:36:271
2271099523,41cyclictest0-21swapper/122:46:241
2271099523,41cyclictest0-21swapper/119:01:191
2271099523,25cyclictest2606-21ntp_offset20:16:321
2271099522,44cyclictest0-21swapper/123:16:131
2271099522,43cyclictest0-21swapper/119:21:361
22710995211,24cyclictest32475-21proc_pri22:26:301
92912513,10sleep10-21swapper/121:39:131
92382510,6sleep334-21rcuc/322:46:173
91132513,42sleep10-21swapper/123:52:431
82442512,9sleep20-21swapper/220:30:582
75072512,9sleep20-21swapper/219:21:212
306662512,10sleep30-21swapper/322:22:483
2271299515,28cyclictest0-21swapper/323:16:143
2271299515,28cyclictest0-21swapper/320:21:233
2271299515,27cyclictest0-21swapper/320:01:063
2271299514,29cyclictest0-21swapper/321:51:313
2271299514,28cyclictest0-21swapper/319:26:183
2271299514,27cyclictest0-21swapper/322:45:593
2271299514,26cyclictest0-21swapper/320:34:443
2271299514,24cyclictest0-21swapper/323:31:103
22712995134,11cyclictest28672-21kernelversion21:11:263
22712995120,13cyclictest0-21swapper/323:56:263
2271199516,28cyclictest0-21swapper/222:07:592
2271199514,30cyclictest0-21swapper/219:01:422
2271199514,29cyclictest0-21swapper/223:26:272
2271199514,25cyclictest0-21swapper/218:57:282
2271199514,25cyclictest0-21swapper/218:57:282
2271199513,43cyclictest0-21swapper/219:46:312
2271199513,40cyclictest24204-21telnet19:56:182
2271199513,30cyclictest0-21swapper/221:11:192
2271199512,44cyclictest0-21swapper/222:56:172
2271199512,43cyclictest0-21swapper/221:21:362
2271099514,25cyclictest0-21swapper/123:46:091
2271099514,25cyclictest0-21swapper/123:46:091
2271099514,23cyclictest0-21swapper/122:06:121
2271099513,41cyclictest0-21swapper/119:26:191
70072502,9sleep30-21swapper/321:35:493
298752503,10sleep10-21swapper/120:06:311
296722503,10sleep10-21swapper/121:14:471
2271299506,27cyclictest0-21swapper/319:37:353
2271299506,27cyclictest0-21swapper/319:37:353
2271299505,27cyclictest0-21swapper/323:00:593
2271299505,27cyclictest0-21swapper/320:41:383
2271299505,27cyclictest0-21swapper/320:12:403
2271299504,28cyclictest0-21swapper/322:31:233
2271299504,28cyclictest0-21swapper/322:01:233
2271299504,28cyclictest0-21swapper/319:41:313
2271299504,28cyclictest0-21swapper/319:21:293
2271299504,27cyclictest0-21swapper/322:36:093
2271299504,27cyclictest0-21swapper/322:16:003
2271299504,27cyclictest0-21swapper/321:11:033
2271299504,27cyclictest0-21swapper/320:56:203
22712995018,14cyclictest0-21swapper/322:06:123
2271199504,30cyclictest0-21swapper/223:56:212
2271199504,30cyclictest0-21swapper/221:51:232
2271199504,28cyclictest0-21swapper/220:01:422
2271199503,39cyclictest15634-21latency_hist20:46:042
2271199503,29cyclictest0-21swapper/219:31:162
2271199503,27cyclictest0-21swapper/200:06:272
22711995020,13cyclictest0-21swapper/200:01:222
2271199502,43cyclictest0-21swapper/223:41:242
2271199502,34cyclictest0-21swapper/221:56:282
2271099504,27cyclictest0-21swapper/120:41:251
2271099503,42cyclictest0-21swapper/123:06:201
2271099503,42cyclictest0-21swapper/123:06:201
2271099503,41cyclictest0-21swapper/122:21:121
2271099503,40cyclictest0-21swapper/120:46:161
2271099503,40cyclictest0-21swapper/119:46:381
2271099503,40cyclictest0-21swapper/119:41:181
22710995019,13cyclictest0-21swapper/118:51:361
320822493,40sleep10-21swapper/121:20:071
248632492,40sleep20-21swapper/221:04:202
248632492,40sleep20-21swapper/221:04:202
2271299495,28cyclictest0-21swapper/321:57:073
2271299494,28cyclictest0-21swapper/321:16:303
2271299494,28cyclictest0-21swapper/319:06:243
2271299494,27cyclictest0-21swapper/321:06:033
2271299494,27cyclictest0-21swapper/321:06:033
2271299494,27cyclictest0-21swapper/320:06:053
2271299494,27cyclictest0-21swapper/319:46:323
2271199497,25cyclictest0-21swapper/200:15:562
2271199496,19cyclictest114550irq/46-eth019:26:272
2271199494,29cyclictest0-21swapper/221:32:532
2271199494,28cyclictest0-21swapper/219:51:302
2271199494,28cyclictest0-21swapper/219:41:342
2271199494,27cyclictest0-21swapper/221:06:172
2271199493,25cyclictest0-21swapper/223:11:182
2271199492,9cyclictest0-21swapper/222:26:382
22711994919,14cyclictest0-21swapper/222:51:122
2271099494,27cyclictest0-21swapper/121:01:281
2271099494,27cyclictest0-21swapper/121:01:281
2271099493,41cyclictest0-21swapper/121:41:151
2271099493,41cyclictest0-21swapper/121:41:151
2271099493,40cyclictest0-21swapper/122:41:311
2271099493,40cyclictest0-21swapper/121:46:221
2271099493,27cyclictest0-21swapper/119:17:321
2271099492,42cyclictest0-21swapper/120:01:421
2271099492,41cyclictest0-21swapper/122:36:211
199322492,41sleep30-21swapper/320:52:283
227532482,9sleep20-21swapper/223:16:042
2271299484,27cyclictest0-21swapper/320:51:033
2271299484,26cyclictest0-21swapper/319:32:343
22712994831,11cyclictest21285-21hwlatdetect23:11:183
2271299483,26cyclictest0-21swapper/323:29:383
2271199484,38cyclictest0-21swapper/221:16:172
2271199484,26cyclictest32085-21turbostat23:35:562
22711994833,9cyclictest18817-21cut20:51:232
2271199483,29cyclictest0-21swapper/221:46:212
2271199483,28cyclictest0-21swapper/222:01:172
2271199483,28cyclictest0-21swapper/220:11:232
2271199483,28cyclictest0-21swapper/219:06:232
2271199483,25cyclictest0-21swapper/218:46:362
2271199483,24cyclictest0-21swapper/219:16:302
2271199482,42cyclictest0-21swapper/223:01:352
22711994815,13cyclictest0-21swapper/220:41:042
2271099484,35cyclictest0-21swapper/123:31:101
2271099483,40cyclictest1369-21runrttasks23:14:011
2271099483,40cyclictest0-21swapper/122:56:151
2271099483,40cyclictest0-21swapper/121:57:581
2271299474,26cyclictest0-21swapper/322:16:133
2271299474,26cyclictest0-21swapper/318:47:263
22712994729,11cyclictest22493-21gltestperf19:51:253
2271199473,24cyclictest0-21swapper/221:41:332
2271199473,24cyclictest0-21swapper/221:41:332
2271199472,40cyclictest0-21swapper/222:43:422
2271099474,37cyclictest0-21swapper/121:21:291
2271199468,32cyclictest0-21swapper/223:06:092
2271199468,32cyclictest0-21swapper/223:06:092
2271199464,18cyclictest0-21swapper/220:46:152
2271199463,23cyclictest0-21swapper/221:26:162
2271099465,35cyclictest0-21swapper/119:51:211
2271199443,24cyclictest0-21swapper/222:11:122
223382424,32sleep30-21swapper/318:41:493
22710993911,18cyclictest0-21swapper/118:46:081
2271199363,26cyclictest22684-21latency_hist18:46:092
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional