You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-18 - 15:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Thu Sep 18, 2025 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
907699984,12cyclictest0-21swapper/106:37:511
907999953,28cyclictest106250irq/46-eth010:03:043
907999953,28cyclictest106250irq/46-eth010:03:043
907999934,27cyclictest0-21swapper/308:52:373
907999925,26cyclictest0-21swapper/310:17:513
9076999219,12cyclictest1160-21snmpd05:35:331
907999893,28cyclictest0-21swapper/308:07:393
907999884,26cyclictest0-21swapper/310:48:003
907999884,26cyclictest0-21swapper/310:48:003
907699874,14cyclictest0-21swapper/106:27:541
907699874,14cyclictest0-21swapper/106:27:541
9079998431,46cyclictest26330-21cut05:57:573
9079998331,43cyclictest135762chrt08:52:563
907999833,26cyclictest0-21swapper/309:02:583
9076998321,12cyclictest0-21swapper/107:38:031
907999824,70cyclictest0-21swapper/307:43:013
907999824,70cyclictest0-21swapper/307:20:243
907999823,22cyclictest0-21swapper/306:43:013
907999814,13cyclictest0-21swapper/307:33:093
907999813,27cyclictest0-21swapper/307:38:003
9079998123,10cyclictest15268-21needreboot05:33:093
907999803,27cyclictest0-21swapper/310:07:583
9079998025,49cyclictest0-21swapper/306:37:593
907999794,26cyclictest0-21swapper/309:52:483
9079997920,9cyclictest27469-21cpuspeed_turbos07:07:553
9079997920,9cyclictest19956-21needreboot07:58:003
9079997913,12cyclictest0-21swapper/307:02:033
907999784,25cyclictest0-21swapper/309:35:143
9079997822,8cyclictest23027-21vmstat05:48:173
9079997821,10cyclictest18447-21gltestperf06:48:013
907999774,15cyclictest0-21swapper/305:55:363
907999773,12cyclictest0-21swapper/309:17:413
907999773,12cyclictest0-21swapper/309:17:413
9079997728,41cyclictest4587-21nscd08:47:363
9079997722,9cyclictest1265-21runrttasks06:53:023
9079997719,9cyclictest2290-21cpuspeed_turbos09:37:533
9079997713,13cyclictest0-21swapper/308:07:523
907999764,32cyclictest0-21swapper/310:37:573
907999764,20cyclictest0-21swapper/307:27:233
907999764,13cyclictest0-21swapper/305:28:073
9079997623,10cyclictest4115-21gltestperf06:18:033
9079997620,9cyclictest17304-21gltestperf05:38:073
9079997619,11cyclictest21450-21timerandwakeup09:08:113
223099760,18rtkit-daemon0-21swapper/007:13:380
223099760,18rtkit-daemon0-21swapper/007:13:380
223099760,18rtkit-daemon0-21swapper/005:24:050
907999754,24cyclictest0-21swapper/310:32:473
907999754,23cyclictest0-21swapper/309:47:463
907999754,22cyclictest0-21swapper/308:22:383
907999754,11cyclictest0-21swapper/309:26:083
907999754,11cyclictest0-21swapper/309:26:083
9079997523,7cyclictest26332-21df_abs10:27:473
9079997522,9cyclictest5096-21sshd08:34:213
9079997521,9cyclictest19194-21cpuspeed_turbos05:42:553
9079997520,9cyclictest5305-21gltestperf07:28:033
223099750,18rtkit-daemon0-21swapper/009:22:480
223099750,18rtkit-daemon0-21swapper/009:22:480
907999744,12cyclictest0-21swapper/306:33:043
907999743,31cyclictest0-21swapper/308:17:513
907999743,28cyclictest9335-21sh06:28:093
907999743,28cyclictest9335-21sh06:28:093
907999743,21cyclictest15135-21munin-node08:57:573
9079997424,10cyclictest19397-21fschecks_time10:12:513
9079997420,9cyclictest10096-21gltestperf05:23:033
9079997414,8cyclictest106250irq/46-eth007:02:533
907999734,24cyclictest0-21swapper/308:37:543
907999734,24cyclictest0-21swapper/308:37:543
907999733,13cyclictest0-21swapper/309:57:473
9079997321,9cyclictest1537-21gltestperf08:27:573
9079997319,7cyclictest26938-21grep08:13:003
9079997217,9cyclictest924-21rsyslogd06:12:423
907999714,25cyclictest0-21swapper/307:53:133
907999714,25cyclictest0-21swapper/307:53:133
907999714,21cyclictest0-21swapper/307:47:523
907999713,8cyclictest3037-21sh06:17:423
9079997118,12cyclictest0-21swapper/306:03:053
907999704,24cyclictest0-21swapper/309:13:073
907999703,9cyclictest31169-21unixbench_multi09:28:083
9079997020,8cyclictest5555-21needreboot09:43:003
907999694,32cyclictest0-21swapper/307:12:513
907999694,32cyclictest0-21swapper/307:12:513
907999694,24cyclictest0-21swapper/310:22:483
223099680,10rtkit-daemon0-21swapper/005:50:560
97052674,13sleep00-21swapper/009:52:520
907999674,22cyclictest5430-21latency_hist06:22:433
223099670,9rtkit-daemon0-21swapper/008:00:060
223099670,9rtkit-daemon0-21swapper/005:57:030
223099670,9rtkit-daemon0-21swapper/005:45:260
223099670,8rtkit-daemon0-21swapper/006:59:380
223099670,7rtkit-daemon0-21swapper/008:12:350
223099670,10rtkit-daemon0-21swapper/007:56:210
223099670,10rtkit-daemon0-21swapper/007:56:210
9078996650,12cyclictest0-21swapper/207:37:542
223099660,9rtkit-daemon0-21swapper/006:32:320
223099660,9rtkit-daemon0-21swapper/006:32:320
223099660,9rtkit-daemon0-21swapper/006:08:330
223099660,9rtkit-daemon0-21swapper/005:38:410
223099660,9rtkit-daemon0-21swapper/005:36:570
223099660,8rtkit-daemon0-21swapper/009:03:330
223099660,8rtkit-daemon0-21swapper/009:02:330
223099660,8rtkit-daemon0-21swapper/008:57:110
223099660,8rtkit-daemon0-21swapper/008:33:050
223099660,8rtkit-daemon0-21swapper/008:19:130
223099660,8rtkit-daemon0-21swapper/007:37:290
223099660,8rtkit-daemon0-21swapper/007:20:070
223099660,8rtkit-daemon0-21swapper/007:05:010
223099660,8rtkit-daemon0-21swapper/006:17:470
223099660,8rtkit-daemon0-21swapper/006:14:330
223099660,8rtkit-daemon0-21swapper/006:00:030
223099660,7rtkit-daemon0-21swapper/010:29:150
223099660,7rtkit-daemon0-21swapper/008:49:410
223099660,7rtkit-daemon0-21swapper/008:44:120
223099660,7rtkit-daemon0-21swapper/008:38:270
223099660,7rtkit-daemon0-21swapper/008:38:270
223099660,7rtkit-daemon0-21swapper/008:32:050
223099660,7rtkit-daemon0-21swapper/008:04:360
223099660,7rtkit-daemon0-21swapper/006:53:460
223099660,7rtkit-daemon0-21swapper/006:49:240
223099660,7rtkit-daemon0-21swapper/006:25:250
223099660,7rtkit-daemon0-21swapper/006:04:330
223099660,6rtkit-daemon0-21swapper/007:48:360
223099660,6rtkit-daemon0-21swapper/007:42:290
223099660,6rtkit-daemon0-21swapper/006:34:170
223099660,12rtkit-daemon0-21swapper/007:07:450
9079996522,8cyclictest1066-21df_abs10:42:463
223099650,9rtkit-daemon0-21swapper/007:45:440
223099650,8rtkit-daemon0-21swapper/008:16:130
223099650,8rtkit-daemon0-21swapper/007:27:220
223099650,7rtkit-daemon0-21swapper/008:23:350
223099650,6rtkit-daemon0-21swapper/007:31:520
223099640,7rtkit-daemon0-21swapper/009:28:020
223099640,6rtkit-daemon0-21swapper/010:27:080
223099640,6rtkit-daemon0-21swapper/005:30:420
223099640,5rtkit-daemon0-21swapper/006:47:310
223099640,10rtkit-daemon0-21swapper/010:02:090
907699595,46cyclictest13774-21irqstats08:53:001
9076995929,9cyclictest26862-21awk09:22:351
9076995929,9cyclictest26862-21awk09:22:351
907899583,47cyclictest11622-21taskset05:27:452
907899582,49cyclictest0-21swapper/207:23:112
227572583,11sleep20-21swapper/206:57:572
907299573,48cyclictest0-21swapper/010:03:010
907299573,48cyclictest0-21swapper/010:03:010
907299573,47cyclictest0-21swapper/006:37:500
9072995723,13cyclictest0-21swapper/009:13:100
907299572,47cyclictest0-21swapper/010:47:520
907299572,47cyclictest0-21swapper/010:47:520
907899565,42cyclictest0-21swapper/210:12:442
907699565,12cyclictest0-21swapper/110:48:301
907699565,12cyclictest0-21swapper/110:48:301
907699565,12cyclictest0-21swapper/106:43:161
907299568,28cyclictest0-21swapper/009:36:100
907299565,44cyclictest317-21awk10:42:320
9072995623,14cyclictest0-21swapper/009:20:080
9072995623,14cyclictest0-21swapper/009:20:080
9072995622,15cyclictest0-21swapper/010:42:520
907299562,47cyclictest0-21swapper/009:38:080
907299557,28cyclictest0-21swapper/009:43:060
173742554,10sleep20-21swapper/207:53:032
173742554,10sleep20-21swapper/207:53:032
907899545,40cyclictest0-21swapper/210:50:152
907899545,40cyclictest0-21swapper/210:50:152
907899544,43cyclictest0-21swapper/205:48:002
9078995437,10cyclictest8343-21runrttasks09:48:052
907899543,45cyclictest0-21swapper/207:03:072
9078995421,13cyclictest1160-21snmpd06:00:372
907899542,46cyclictest0-21swapper/205:53:162
9078995418,13cyclictest0-21swapper/209:32:352
9076995425,24cyclictest0-21swapper/108:12:111
9076995423,13cyclictest0-21swapper/107:14:551
9076995423,13cyclictest0-21swapper/107:14:551
907299544,44cyclictest0-21swapper/010:33:050
907299544,29cyclictest0-21swapper/010:07:460
52222543,9sleep20-21swapper/206:20:082
295132543,10sleep20-21swapper/208:18:062
907899535,40cyclictest0-21swapper/206:22:592
907899535,40cyclictest0-21swapper/206:08:002
907899535,30cyclictest0-21swapper/208:33:122
907899535,28cyclictest0-21swapper/207:27:542
907899534,42cyclictest0-21swapper/208:23:052
907899534,26cyclictest0-21swapper/210:29:162
907899534,26cyclictest0-21swapper/208:07:562
9078995337,10cyclictest12448-21grep07:43:022
9078995323,23cyclictest0-21swapper/205:33:012
907299535,28cyclictest0-21swapper/010:13:030
907299533,27cyclictest0-21swapper/009:08:080
907299533,22cyclictest6889-21telnet09:47:460
230582534,42sleep00-21swapper/010:20:210
129402533,43sleep112962-21ntp_states05:28:111
124922534,9sleep10-21swapper/106:36:281
907899525,40cyclictest0-21swapper/207:57:482
907899525,40cyclictest0-21swapper/205:43:142
907899525,38cyclictest0-21swapper/210:32:502
907899525,29cyclictest0-21swapper/208:58:102
907899525,29cyclictest0-21swapper/206:45:432
907899525,28cyclictest0-21swapper/208:51:202
907899525,28cyclictest0-21swapper/205:28:052
907899524,40cyclictest0-21swapper/209:17:592
907899524,40cyclictest0-21swapper/209:17:592
907899524,40cyclictest0-21swapper/208:03:082
907899524,40cyclictest0-21swapper/207:32:502
907899524,40cyclictest0-21swapper/207:13:072
907899524,40cyclictest0-21swapper/207:13:072
907899524,40cyclictest0-21swapper/206:38:002
907899524,40cyclictest0-21swapper/206:28:082
907899524,40cyclictest0-21swapper/206:28:082
907899524,30cyclictest0-21swapper/209:58:002
907899524,28cyclictest0-21swapper/208:32:382
9078995218,15cyclictest0-21swapper/208:13:112
9078995217,15cyclictest0-21swapper/206:48:112
9078995210,34cyclictest0-21swapper/206:02:562
907699528,24cyclictest0-21swapper/107:32:391
291102523,9sleep20-21swapper/209:25:572
291102523,9sleep20-21swapper/209:25:572
158042523,10sleep20-21swapper/210:04:232
158042523,10sleep20-21swapper/210:04:232
907899515,38cyclictest0-21swapper/210:42:472
907899515,28cyclictest0-21swapper/209:43:052
907899515,28cyclictest0-21swapper/207:18:112
907899515,27cyclictest0-21swapper/206:13:012
907899514,40cyclictest0-21swapper/209:32:562
907899514,29cyclictest0-21swapper/210:08:022
907899514,28cyclictest0-21swapper/210:22:452
907899514,28cyclictest0-21swapper/208:52:592
907899514,28cyclictest0-21swapper/205:38:032
907899514,26cyclictest0-21swapper/209:12:472
907899514,25cyclictest0-21swapper/208:37:492
907899514,25cyclictest0-21swapper/208:37:492
9078995121,13cyclictest0-21swapper/207:08:122
9078995120,13cyclictest0-21swapper/206:32:542
907699514,28cyclictest0-21swapper/108:17:371
208142512,43sleep10-21swapper/105:45:281
184612512,9sleep10-21swapper/107:56:531
184612512,9sleep10-21swapper/107:56:531
907899504,38cyclictest19976-21head09:07:512
907899504,28cyclictest0-21swapper/210:37:452
907899504,28cyclictest0-21swapper/207:48:122
9078995033,10cyclictest9988-21sed09:52:542
9078995018,13cyclictest0-21swapper/209:06:042
9076995033,10cyclictest21972-21head08:02:581
265712502,41sleep10-21swapper/107:03:201
223099500,5rtkit-daemon2229-21rtkit-daemon05:18:122
907899494,27cyclictest0-21swapper/208:42:532
9078994918,13cyclictest0-21swapper/206:55:442
9076994930,13cyclictest0-21swapper/107:22:401
62942493,40sleep10-21swapper/106:23:011
257232492,41sleep10-21swapper/105:57:171
229012492,41sleep10-21swapper/110:18:201
174832493,40sleep117488-21irqstats05:38:111
169202495,10sleep10-21swapper/108:58:111
907699485,12cyclictest0-21swapper/109:52:581
907699484,38cyclictest0-21swapper/109:24:501
907699484,38cyclictest0-21swapper/109:24:501
282372482,39sleep10-21swapper/110:32:431
907899473,27cyclictest0-21swapper/210:18:052
9078994718,11cyclictest0-21swapper/209:38:032
907699473,39cyclictest0-21swapper/106:07:221
9076994724,7cyclictest2923-21cat10:47:321
9076994723,9cyclictest106250irq/46-eth008:18:101
9076994718,14cyclictest0-21swapper/109:29:151
907299474,27cyclictest0-21swapper/005:22:450
74612474,10sleep10-21swapper/108:39:091
74612474,10sleep10-21swapper/108:39:091
277232472,39sleep10-21swapper/110:29:001
196742474,10sleep10-21swapper/106:51:431
107412472,8sleep110808-21cat05:23:151
907699464,26cyclictest0-21swapper/107:57:551
9076994628,11cyclictest20354-21df_abs09:07:551
253392462,38sleep10-21swapper/110:24:001
244752462,39sleep10-21swapper/107:02:071
13592463,37sleep10-21swapper/109:34:351
907699454,36cyclictest40532chrt09:41:561
9076994532,8cyclictest21452-21sort05:47:561
9076994527,13cyclictest0-21swapper/107:33:091
159052452,37sleep10-21swapper/110:05:431
159052452,37sleep10-21swapper/110:05:431
907699445,33cyclictest0-21swapper/108:47:311
907699444,34cyclictest0-21swapper/110:02:331
907699444,33cyclictest0-21swapper/106:18:151
907699444,25cyclictest1160-21snmpd06:52:441
907699444,24cyclictest0-21swapper/110:12:551
907699443,35cyclictest0-21swapper/106:12:421
9076994429,9cyclictest28848-21tail07:08:141
9076994426,12cyclictest7939-21needreboot09:47:581
9076994423,9cyclictest0-21swapper/107:43:081
9076994412,19cyclictest15199-21kworker/1:109:42:471
327672443,10sleep10-21swapper/108:26:271
326862442,36sleep10-21swapper/110:41:301
281162442,36sleep10-21swapper/106:02:251
27562442,36sleep10-21swapper/108:30:021
907699435,12cyclictest0-21swapper/110:08:001
907699434,32cyclictest0-21swapper/109:12:451
9076994324,12cyclictest0-21swapper/107:23:021
122792432,35sleep10-21swapper/108:49:371
9076994224,12cyclictest3201-21munin-node08:32:561
9076994217,10cyclictest13987-21munin-node07:47:591
907699413,25cyclictest0-21swapper/106:12:541
195412412,34sleep10-21swapper/109:05:531
907699334,24cyclictest9143-21sed05:22:451
907999322,26cyclictest0-21swapper/305:22:453
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional