You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-02 - 06:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Thu Apr 02, 2026 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1557621100,6sleep315575-21sort22:01:543
71122860,3sleep1201ktimersoftd/119:26:591
1407599736,61cyclictest0-21swapper/220:17:052
1407699714,60cyclictest0-21swapper/319:51:463
14074997145,9cyclictest25799-21crond20:41:441
14075996935,12cyclictest0-21swapper/221:06:542
14074996940,13cyclictest0-21swapper/119:32:161
14074996940,13cyclictest0-21swapper/119:06:591
1407599683,57cyclictest0-21swapper/220:11:052
14075996735,14cyclictest0-21swapper/218:57:162
14074996730,22cyclictest0-21swapper/120:19:171
1407599665,54cyclictest0-21swapper/220:01:472
1407599665,54cyclictest0-21swapper/220:01:472
1407499667,51cyclictest16946-21hwlatdetect20:27:051
14074996637,12cyclictest0-21swapper/122:51:521
14076996537,13cyclictest0-21swapper/320:23:413
1407599653,55cyclictest0-21swapper/222:52:122
14074996539,12cyclictest0-21swapper/120:32:141
14074996539,12cyclictest0-21swapper/120:32:141
248599640,25rtkit-daemon2484-21rtkit-daemon21:29:242
1407599644,55cyclictest0-21swapper/219:42:072
14075996434,13cyclictest0-21swapper/221:12:182
14075996434,13cyclictest0-21swapper/221:12:182
14075996434,13cyclictest0-21swapper/220:57:132
1407599643,54cyclictest0-21swapper/222:49:382
14074996438,11cyclictest0-21swapper/121:47:031
14074996438,11cyclictest0-21swapper/119:37:031
14074996437,12cyclictest0-21swapper/122:21:401
14074996436,12cyclictest0-21swapper/121:36:591
14070996425,32cyclictest24739-21fschecks_count21:27:000
130052643,53sleep10-21swapper/121:57:051
248599630,9rtkit-daemon2484-21rtkit-daemon19:32:212
248599630,5rtkit-daemon2484-21rtkit-daemon20:47:332
1407699633,13cyclictest0-21swapper/321:51:593
1407699633,13cyclictest0-21swapper/321:51:593
1407599634,53cyclictest0-21swapper/221:51:532
1407599634,53cyclictest0-21swapper/221:51:532
14075996334,13cyclictest0-21swapper/220:02:182
1407599632,53cyclictest20531-21rm20:32:112
1407599632,53cyclictest20531-21rm20:32:112
1407499639,8cyclictest0-21swapper/119:53:111
14074996337,12cyclictest0-21swapper/121:22:001
32242623,12sleep10-21swapper/120:55:291
1407699625,50cyclictest2391-21df_inode21:41:573
1407699624,51cyclictest0-21swapper/320:41:463
1407599624,52cyclictest0-21swapper/221:34:122
14075996234,13cyclictest0-21swapper/219:47:062
1407599623,54cyclictest0-21swapper/217:37:032
1407599623,53cyclictest0-21swapper/222:32:162
14074996239,7cyclictest19343-21sh19:42:191
14074996237,10cyclictest0-21swapper/120:57:071
14074996236,10cyclictest0-21swapper/121:01:571
14074996235,12cyclictest0-21swapper/120:09:541
14074996230,15cyclictest0-21swapper/122:31:011
14074996230,15cyclictest0-21swapper/122:31:011
14070996243,8cyclictest14810-21ssh20:23:280
12202624,10sleep31310-21ssh20:52:043
1407599614,51cyclictest0-21swapper/222:42:052
1407599614,50cyclictest0-21swapper/220:41:592
1407599614,50cyclictest0-21swapper/218:07:062
14075996133,13cyclictest0-21swapper/220:26:582
14075996132,13cyclictest0-21swapper/222:07:132
14075996132,13cyclictest0-21swapper/221:02:162
14075996132,13cyclictest0-21swapper/218:52:132
1407599613,51cyclictest31208-21python19:07:172
1407599613,51cyclictest30787-21telnet21:36:532
1407599613,51cyclictest0-21swapper/220:12:132
1407599613,50cyclictest0-21swapper/217:31:522
1407599612,52cyclictest1287-21snmpd21:24:322
14074996137,11cyclictest0-21swapper/122:46:541
14074996137,10cyclictest0-21swapper/122:11:031
14074996133,11cyclictest0-21swapper/120:51:451
14070996143,10cyclictest12990-21crond22:46:400
112792613,50sleep00-21swapper/021:55:180
112792613,50sleep00-21swapper/021:55:180
1407699604,49cyclictest0-21swapper/321:27:113
14076996021,9cyclictest3775-21df_inode22:31:563
14075996033,13cyclictest0-21swapper/219:40:012
14075996032,13cyclictest0-21swapper/222:27:442
14075996032,13cyclictest0-21swapper/222:27:442
14075996032,13cyclictest0-21swapper/220:23:432
1407599603,52cyclictest0-21swapper/221:20:522
1407599603,50cyclictest0-21swapper/217:42:192
14074996038,8cyclictest1247-21lldpd21:34:211
14074996034,12cyclictest0-21swapper/122:24:431
14074996033,11cyclictest0-21swapper/121:51:531
14074996033,11cyclictest0-21swapper/121:51:531
14074996032,11cyclictest0-21swapper/119:17:111
14074996032,11cyclictest0-21swapper/119:17:111
1407699595,48cyclictest0-21swapper/318:16:503
1407699595,47cyclictest0-21swapper/322:11:593
1407699595,15cyclictest0-21swapper/320:07:163
1407699594,48cyclictest0-21swapper/319:27:083
1407699594,13cyclictest0-21swapper/321:32:453
1407699594,12cyclictest0-21swapper/319:52:203
1407699594,10cyclictest1589-21yum22:27:133
1407699594,10cyclictest1589-21yum22:27:133
1407699593,25cyclictest1419-21runrttasks21:21:463
14076995918,11cyclictest935-21munin-node18:07:113
1407599594,47cyclictest0-21swapper/221:47:072
14075995932,12cyclictest0-21swapper/219:29:082
14075995931,13cyclictest0-21swapper/221:57:032
14075995931,12cyclictest0-21swapper/220:51:562
1407599593,49cyclictest0-21swapper/222:12:142
1407599593,48cyclictest17206-21ssh22:02:202
14075995928,16cyclictest0-21swapper/222:20:202
14074995936,9cyclictest22469-21df22:11:561
14074995935,11cyclictest0-21swapper/121:18:101
14074995934,9cyclictest32149-21munin-node19:12:011
14074995933,11cyclictest0-21swapper/119:26:481
14074995932,11cyclictest0-21swapper/122:05:371
14074995932,11cyclictest0-21swapper/120:42:091
14070995922,23cyclictest3537-21ssh21:42:140
1407699586,46cyclictest0-21swapper/322:08:553
1407699585,10cyclictest14073-21munin-node19:36:593
1407699584,48cyclictest0-21swapper/321:17:003
1407699584,12cyclictest0-21swapper/320:47:033
14076995822,32cyclictest0-21swapper/318:42:133
14076995821,11cyclictest0-21swapper/322:52:233
14076995819,10cyclictest15444-21munin-node18:37:213
14076995810,32cyclictest0-21swapper/320:12:133
14075995832,12cyclictest0-21swapper/219:02:072
14075995830,12cyclictest0-21swapper/218:47:072
1407599583,50cyclictest0-21swapper/222:36:532
1407599583,49cyclictest0-21swapper/221:41:522
14075995828,15cyclictest0-21swapper/219:54:122
14074995835,9cyclictest5869-21munin-node20:12:001
14074995833,12cyclictest0-21swapper/120:04:491
297292573,46sleep30-21swapper/317:57:143
1407699575,27cyclictest0-21swapper/318:27:003
1407699575,25cyclictest0-21swapper/319:42:083
1407699575,11cyclictest772-21unixbench_multi20:02:203
1407699574,48cyclictest0-21swapper/321:07:063
1407699574,47cyclictest0-21swapper/319:34:323
1407699574,22cyclictest8604-21ssh22:37:563
1407699574,13cyclictest0-21swapper/320:17:183
1407699573,9cyclictest25586-21awk17:47:233
1407699573,9cyclictest25586-21awk17:47:233
1407699573,48cyclictest0-21swapper/322:01:423
1407599574,46cyclictest0-21swapper/222:22:072
14075995729,13cyclictest0-21swapper/220:39:302
14074995733,11cyclictest0-21swapper/119:49:061
14074995733,10cyclictest0-21swapper/121:13:441
14074995733,10cyclictest0-21swapper/121:13:441
14074995732,12cyclictest0-21swapper/121:28:171
14074995732,10cyclictest23400-21gltestperf18:52:081
14074995731,12cyclictest0-21swapper/117:37:011
14074995730,12cyclictest0-21swapper/122:45:251
14074995729,15cyclictest0-21swapper/122:35:551
1407099575,45cyclictest0-21swapper/020:27:160
14070995724,19cyclictest2345-21ssh20:52:210
281702564,43sleep30-21swapper/319:02:073
1407699565,13cyclictest0-21swapper/321:12:143
1407699565,13cyclictest0-21swapper/321:12:143
1407699564,47cyclictest0-21swapper/320:42:153
1407699564,46cyclictest1419-21runrttasks19:57:053
1407699564,46cyclictest1419-21runrttasks19:57:053
1407699564,45cyclictest0-21swapper/321:47:553
1407699564,45cyclictest0-21swapper/320:27:003
1407699564,45cyclictest0-21swapper/319:12:123
1407699564,30cyclictest0-21swapper/322:46:573
1407699563,47cyclictest12377-21rm22:44:263
1407699563,35cyclictest0-21swapper/320:33:443
1407699563,35cyclictest0-21swapper/320:33:443
1407599563,46cyclictest0-21swapper/217:32:172
14074995631,11cyclictest0-21swapper/121:46:371
14074995627,13cyclictest0-21swapper/117:42:201
14074995627,12cyclictest0-21swapper/119:57:191
14074995627,12cyclictest0-21swapper/119:57:191
14070995632,8cyclictest26218-21ssh22:17:000
115552563,45sleep00-21swapper/020:18:510
62462554,12sleep30-21swapper/318:17:053
1407699556,23cyclictest0-21swapper/322:22:193
1407699554,45cyclictest0-21swapper/321:37:073
1407699554,45cyclictest0-21swapper/318:23:223
1407699554,21cyclictest9065-21users21:02:193
14074995533,9cyclictest30083-21switchtime17:57:211
14074995531,9cyclictest16680-21munin-node17:32:211
14074995522,14cyclictest0-21swapper/120:26:091
1407099555,43cyclictest0-21swapper/022:52:020
14070995528,12cyclictest0-21swapper/021:01:500
182632545,11sleep00-21swapper/022:06:150
1407699544,44cyclictest0-21swapper/317:27:123
1407699544,23cyclictest0-21swapper/320:58:123
1407599543,45cyclictest0-21swapper/218:43:252
1407499544,15cyclictest0-21swapper/122:37:071
14074995430,11cyclictest0-21swapper/121:07:161
1407099543,10cyclictest0-21swapper/019:30:530
14070995428,13cyclictest0-21swapper/020:02:010
313632532,9sleep00-21swapper/020:47:340
1407699534,26cyclictest0-21swapper/322:19:173
1407699533,45cyclictest0-21swapper/317:33:133
1407599534,11cyclictest0-21swapper/218:22:072
1407599533,41cyclictest0-21swapper/217:52:152
1407499534,29cyclictest0-21swapper/118:22:081
1407499534,29cyclictest0-21swapper/118:06:521
14074995328,12cyclictest0-21swapper/117:52:161
14074995326,13cyclictest0-21swapper/119:06:131
14074995326,12cyclictest0-21swapper/118:32:401
14074995326,12cyclictest0-21swapper/118:32:401
1407099535,40cyclictest0-21swapper/017:47:020
1407099535,40cyclictest0-21swapper/017:47:020
1407099534,13cyclictest0-21swapper/022:07:040
14070995338,11cyclictest0-21swapper/022:01:390
14070995329,8cyclictest16391-21ssh22:51:390
67982522,9sleep00-21swapper/019:26:470
25472522,9sleep00-21swapper/018:07:230
164172524,12sleep20-21swapper/218:37:122
1407699525,29cyclictest0-21swapper/319:18:313
1407699525,29cyclictest0-21swapper/319:18:313
14076995221,9cyclictest0-21swapper/318:59:523
14076995220,12cyclictest0-21swapper/318:52:203
14075995236,9cyclictest3454-21tail19:17:122
14075995236,9cyclictest3454-21tail19:17:122
14075995229,10cyclictest0-21swapper/217:51:522
14075995229,10cyclictest0-21swapper/217:51:522
1407599522,44cyclictest0-21swapper/219:22:052
1407499523,28cyclictest0-21swapper/118:51:481
14074995228,11cyclictest0-21swapper/118:07:251
14074995227,12cyclictest0-21swapper/118:29:131
14074995226,13cyclictest0-21swapper/118:59:461
14074995226,13cyclictest0-21swapper/117:47:091
14074995226,13cyclictest0-21swapper/117:47:091
1407099525,41cyclictest0-21swapper/021:16:410
1407099525,41cyclictest0-21swapper/021:16:410
1407099525,41cyclictest0-21swapper/019:50:350
1407099524,42cyclictest0-21swapper/022:27:000
1407099524,42cyclictest0-21swapper/022:27:000
1407099524,42cyclictest0-21swapper/020:42:060
1407099524,12cyclictest0-21swapper/021:34:340
1407099523,44cyclictest0-21swapper/021:20:310
1407099523,44cyclictest0-21swapper/020:39:490
1407099523,43cyclictest0-21swapper/017:42:010
1407099523,42cyclictest0-21swapper/021:07:010
14070995222,23cyclictest22602-21munin-node18:52:060
59722512,43sleep00-21swapper/020:58:140
230892512,43sleep00-21swapper/021:24:180
1407699514,27cyclictest0-21swapper/317:42:143
1407599514,41cyclictest0-21swapper/218:30:172
1407599513,43cyclictest0-21swapper/218:18:192
1407599513,43cyclictest0-21swapper/218:02:432
1407599513,42cyclictest0-21swapper/217:57:122
1407599513,41cyclictest0-21swapper/218:32:012
1407599513,41cyclictest0-21swapper/218:32:012
14074995126,12cyclictest0-21swapper/118:43:561
14074995126,12cyclictest0-21swapper/118:37:111
14074995126,12cyclictest0-21swapper/118:12:311
1407099515,38cyclictest0-21swapper/019:51:540
14070995136,10cyclictest0-21swapper/019:56:530
14070995136,10cyclictest0-21swapper/019:56:530
14070995135,11cyclictest0-21swapper/019:15:060
14070995124,12cyclictest0-21swapper/018:21:500
125202512,42sleep00-21swapper/018:28:070
248599500,5rtkit-daemon2484-21rtkit-daemon18:02:173
220262502,41sleep00-21swapper/022:11:510
1407699504,40cyclictest0-21swapper/317:52:103
1407699504,14cyclictest0-21swapper/318:47:213
1407599503,42cyclictest0-21swapper/219:12:112
1407599503,41cyclictest0-21swapper/218:14:022
1407499504,27cyclictest0-21swapper/118:18:211
1407099506,11cyclictest0-21swapper/019:42:030
1407099505,40cyclictest0-21swapper/020:32:440
1407099505,40cyclictest0-21swapper/020:32:440
1407099504,39cyclictest0-21swapper/020:13:140
1407099504,11cyclictest0-21swapper/022:22:000
1407099503,41cyclictest0-21swapper/021:47:210
1407099501,42cyclictest0-21swapper/020:07:000
1407699495,38cyclictest0-21swapper/317:37:123
1407499494,28cyclictest0-21swapper/117:26:521
14074994917,13cyclictest0-21swapper/117:27:251
1407099494,41cyclictest0-21swapper/019:19:270
1407099494,41cyclictest0-21swapper/019:19:270
14070994931,7cyclictest6810-21diskmemload22:37:080
1407099493,12cyclictest0-21swapper/022:31:590
14070994921,12cyclictest0-21swapper/019:07:030
1407099486,35cyclictest0-21swapper/019:36:550
1407099484,40cyclictest0-21swapper/021:37:000
1407099484,38cyclictest0-21swapper/018:47:080
1407099484,11cyclictest0-21swapper/019:06:080
14070994822,12cyclictest0-21swapper/018:02:160
306402472,38sleep00-21swapper/018:00:180
248599470,5rtkit-daemon2484-21rtkit-daemon17:23:263
199002472,39sleep00-21swapper/018:45:520
1407699474,37cyclictest0-21swapper/319:24:193
1407699473,25cyclictest0-21swapper/318:33:243
1407699473,25cyclictest0-21swapper/318:33:243
1407699472,41cyclictest0-21swapper/319:09:153
1407099474,10cyclictest0-21swapper/019:32:450
1407099473,9cyclictest14064-21cyclictest17:37:160
14070994723,9cyclictest10433-21idleruntime-cro18:26:490
56052462,9sleep00-21swapper/018:16:300
14070994627,8cyclictest1287-21snmpd17:28:120
14070994620,11cyclictest0-21swapper/017:51:590
14070994519,12cyclictest0-21swapper/018:57:000
14070994425,8cyclictest15444-21munin-node18:37:060
14070994419,9cyclictest13268-21sort18:32:020
14070994419,9cyclictest13268-21sort18:32:020
1407099434,11cyclictest0-21swapper/017:32:200
14075994128,8cyclictest14202-21latency_hist17:26:522
14070994113,10cyclictest7250irq/45-ahci17:26:510
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional