You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-19 - 03:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Thu Mar 19, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1845599965,24cyclictest0-21swapper/121:15:081
18455999622,18cyclictest0-21swapper/120:36:141
1845599955,26cyclictest0-21swapper/122:30:511
18455999421,13cyclictest8470-21users20:20:261
1845399943,84cyclictest22687-21ssh21:30:150
1845399943,83cyclictest23794-21cpuspeed_turbos20:45:030
18455999327,13cyclictest1419-21runrttasks22:14:581
18455999310,22cyclictest10436-21if_err_eth022:00:101
1845599924,26cyclictest19422-21netstat21:25:161
1845599924,26cyclictest15395-21missed_timers22:55:101
18455999234,48cyclictest22660-21head19:55:121
18455999227,11cyclictest5470-21gltestperf21:05:091
18455999221,13cyclictest0-21swapper/123:05:231
1845399923,69cyclictest20421-21ssh19:51:140
1845599915,27cyclictest0-21swapper/119:20:211
1845599914,28cyclictest0-21swapper/122:25:111
1845599914,28cyclictest0-21swapper/122:25:111
1845399913,82cyclictest0-21swapper/021:37:260
1845599905,77cyclictest17924-21unixbench_multi22:10:211
1845599905,75cyclictest3720-21iostat21:50:101
1845599905,31cyclictest0-21swapper/122:35:031
1845599895,33cyclictest0-21swapper/119:10:041
1845599895,27cyclictest0-21swapper/117:50:281
18455998923,12cyclictest25590-21yum-updatesd-he22:23:301
1845399893,80cyclictest21786-21sh19:55:030
1845399893,80cyclictest0-21swapper/022:00:210
18453998916,57cyclictest1676-21nscd22:30:150
1845599885,25cyclictest0-21swapper/119:53:031
1845599884,27cyclictest0-21swapper/119:46:131
1845599884,25cyclictest31979-21cstates21:45:031
1845599884,23cyclictest16325-21cat21:20:211
1845399883,77cyclictest30538-21cpuspeed_turbos20:55:060
1845399883,77cyclictest30538-21cpuspeed_turbos20:55:060
1845599875,27cyclictest0-21swapper/120:06:101
1845599875,18cyclictest0-21swapper/120:00:061
1845599874,35cyclictest1419-21runrttasks20:25:581
1845599874,25cyclictest0-21swapper/119:44:521
1845599874,13cyclictest0-21swapper/121:04:511
1845599874,13cyclictest0-21swapper/120:40:071
18455998718,9cyclictest12200-21ssh22:50:141
1845399873,77cyclictest0-21swapper/020:53:070
1845399873,64cyclictest0-21swapper/020:19:530
248599860,4rtkit-daemon2484-21rtkit-daemon22:49:381
1845599865,27cyclictest0-21swapper/118:30:051
1845599864,21cyclictest0-21swapper/121:43:001
1845599864,13cyclictest14071-21ssh20:30:091
18455998626,12cyclictest0-21swapper/118:45:081
18455998621,13cyclictest0-21swapper/117:55:171
18455998617,12cyclictest0-21swapper/120:51:231
1845399862,78cyclictest0-21swapper/020:10:040
1845399862,78cyclictest0-21swapper/020:10:040
1845599854,27cyclictest0-21swapper/122:43:071
1845599854,12cyclictest0-21swapper/123:04:091
18455998519,13cyclictest0-21swapper/121:35:361
1845399854,75cyclictest0-21swapper/021:05:070
1845399853,75cyclictest12529-21ssh21:15:140
1845599844,31cyclictest0-21swapper/120:44:561
1845599844,27cyclictest0-21swapper/121:30:191
1845599844,22cyclictest4582-21ntp_states20:15:201
18455998417,10cyclictest459-21ssh20:10:111
18455998417,10cyclictest459-21ssh20:10:111
1845399843,75cyclictest19592-21latency_hist18:49:570
1845399843,74cyclictest0-21swapper/022:10:230
1845399843,61cyclictest27760-21mailstats22:25:180
1845399843,61cyclictest27760-21mailstats22:25:180
1845399843,61cyclictest0-21swapper/022:16:470
18453998414,64cyclictest6558-21df_abs21:55:040
1845599835,27cyclictest0-21swapper/117:40:271
1845599834,22cyclictest0-21swapper/120:56:001
1845599834,22cyclictest0-21swapper/120:56:001
18455998317,10cyclictest0-21swapper/118:54:011
18455998317,10cyclictest0-21swapper/118:54:011
18455998316,13cyclictest0-21swapper/121:59:261
1845399839,41cyclictest0-21swapper/023:00:020
1845399834,71cyclictest0-21swapper/021:50:030
1845399833,74cyclictest0-21swapper/022:43:150
1845399833,74cyclictest0-21swapper/022:22:200
1845399833,74cyclictest0-21swapper/021:41:040
1845399833,74cyclictest0-21swapper/019:45:020
1845399833,74cyclictest0-21swapper/018:10:270
1845399833,72cyclictest0-21swapper/018:35:140
1845399833,67cyclictest5476-21munin-node18:20:330
1845399833,55cyclictest0-21swapper/018:40:170
36452820,4sleep337-21ksoftirqd/322:39:113
1845599828,21cyclictest0-21swapper/119:34:561
1845599828,17cyclictest0-21swapper/119:19:551
1845599824,31cyclictest0-21swapper/118:23:311
1845599824,26cyclictest0-21swapper/119:30:151
1845599824,26cyclictest0-21swapper/119:30:151
1845599824,23cyclictest0-21swapper/121:12:521
18455998225,10cyclictest27789-21gltestperf19:05:151
1845399824,70cyclictest0-21swapper/022:50:030
1845399824,70cyclictest0-21swapper/021:21:160
1845399823,72cyclictest23669-21chrt23:08:340
1845399823,72cyclictest0-21swapper/020:41:180
1845399823,71cyclictest0-21swapper/022:49:010
1845399823,62cyclictest0-21swapper/018:15:580
1845399823,57cyclictest0-21swapper/020:39:520
18456998121,52cyclictest1419-21runrttasks17:55:092
1845599814,14cyclictest0-21swapper/118:00:201
1845399814,69cyclictest0-21swapper/022:05:200
1845399814,60cyclictest0-21swapper/021:25:050
1845399813,71cyclictest0-21swapper/020:30:150
1845399813,71cyclictest0-21swapper/017:54:580
1845399813,62cyclictest0-21swapper/020:04:490
18453998115,51cyclictest0-21swapper/021:47:270
1845599804,25cyclictest0-21swapper/119:25:251
18455998021,10cyclictest4426-21grep18:15:251
1845399803,71cyclictest0-21swapper/019:21:090
1845599794,22cyclictest0-21swapper/122:06:561
1845399794,68cyclictest0-21swapper/019:05:240
1845399794,57cyclictest0-21swapper/022:55:090
1845399793,70cyclictest30150-21ssh20:05:200
1845399793,70cyclictest0-21swapper/018:25:260
1845399793,69cyclictest0-21swapper/022:37:020
1845399793,62cyclictest0-21swapper/020:20:570
1845599785,29cyclictest0-21swapper/118:40:081
1845399783,69cyclictest4332-21aten2.4-expect19:25:070
1845399783,69cyclictest0-21swapper/019:42:360
1845399783,67cyclictest30214-21grep19:10:110
1845399783,60cyclictest0-21swapper/021:11:520
1845399783,57cyclictest0-21swapper/021:00:240
1845399783,57cyclictest0-21swapper/020:26:420
18453997814,57cyclictest0-21swapper/018:00:130
248599770,6rtkit-daemon2484-21rtkit-daemon21:15:122
18456997721,34cyclictest23999-21ssh23:09:462
1845599774,25cyclictest14688-21taskset18:38:321
1845599774,15cyclictest0-21swapper/118:55:071
1845599773,33cyclictest0-21swapper/118:27:081
1845399773,68cyclictest0-21swapper/019:02:230
1845399773,67cyclictest0-21swapper/019:36:120
18455997622,12cyclictest21693-21fschecks_count17:45:161
1845399763,67cyclictest0-21swapper/017:58:040
1845399763,55cyclictest19986-21chrt18:50:080
1845399763,55cyclictest19986-21chrt18:50:080
1845399754,64cyclictest0-21swapper/019:15:100
1845399753,66cyclictest0-21swapper/019:30:200
1845399753,66cyclictest0-21swapper/019:30:200
1845399753,66cyclictest0-21swapper/018:56:190
1845399753,65cyclictest23093-21sshd17:48:350
18456997423,42cyclictest4390-21cpuspeed_turbos22:39:592
1845599745,14cyclictest0-21swapper/119:00:231
18455997415,11cyclictest0-21swapper/118:10:011
1845399743,64cyclictest1287-21snmpd18:30:160
1845399743,58cyclictest0-21swapper/018:05:560
1845399743,58cyclictest0-21swapper/018:05:560
1845599734,20cyclictest0-21swapper/118:05:091
1845599734,20cyclictest0-21swapper/118:05:091
1845399735,58cyclictest0-21swapper/017:39:590
18456997220,31cyclictest18115-21munin-node21:25:032
18456997214,51cyclictest28775-21munin-node20:05:282
18456997214,35cyclictest0-21swapper/223:00:332
18456997023,38cyclictest17050-21gltestperf22:10:082
18456997019,44cyclictest10615-21fschecks_count20:25:092
18456997015,35cyclictest0-21swapper/221:55:182
18456997013,51cyclictest0-21swapper/221:45:062
1845399703,54cyclictest0-21swapper/017:40:080
18456996921,31cyclictest18311-21switchtime20:35:242
18456996725,35cyclictest4423-21wc20:15:172
18456996721,30cyclictest25754-21ssh20:46:522
1845699664,55cyclictest0-21swapper/221:05:012
18456996614,43cyclictest0-21swapper/220:56:322
18456996614,43cyclictest0-21swapper/220:56:322
18456996613,34cyclictest0-21swapper/221:22:442
1845699659,49cyclictest0-21swapper/219:50:062
18456996524,33cyclictest23078-21gltestperf18:55:152
18456996514,33cyclictest8429-21grep20:20:252
18456996511,46cyclictest0-21swapper/219:56:482
18456996510,48cyclictest0-21swapper/221:11:192
18456996421,35cyclictest13185-21tr22:05:042
18456996416,31cyclictest11181-21diskmemload20:54:522
18456996413,44cyclictest0-21swapper/222:48:392
18456996413,34cyclictest0-21swapper/221:36:302
18456996412,46cyclictest0-21swapper/222:33:422
18456996412,21cyclictest0-21swapper/219:47:572
1845699632,55cyclictest0-21swapper/221:50:552
18456996312,45cyclictest0-21swapper/219:30:152
18456996312,45cyclictest0-21swapper/219:30:152
18456996311,42cyclictest0-21swapper/220:34:442
1845699627,29cyclictest0-21swapper/221:40:102
1845699624,52cyclictest0-21swapper/222:19:482
18456996221,34cyclictest27165-21grep20:00:272
18456996218,26cyclictest1586-21ssh22:35:062
18456996214,42cyclictest0-21swapper/218:15:292
18456996214,41cyclictest0-21swapper/222:23:132
18456996210,45cyclictest0-21swapper/221:00:022
248599610,5rtkit-daemon0-21swapper/222:07:553
18457996122,22cyclictest0-21swapper/322:48:593
1845699615,50cyclictest0-21swapper/222:25:262
1845699615,50cyclictest0-21swapper/222:25:262
18456996113,41cyclictest0-21swapper/222:50:152
18456996111,43cyclictest0-21swapper/222:00:232
18456996110,44cyclictest0-21swapper/220:14:292
18456996110,44cyclictest0-21swapper/220:14:292
18456996013,41cyclictest0-21swapper/218:10:272
18456996012,40cyclictest0-21swapper/219:40:092
18457995921,22cyclictest8396-21cpuspeed_turbos21:10:033
1845699597,45cyclictest0-21swapper/218:50:122
1845699597,45cyclictest0-21swapper/218:50:122
1845699596,35cyclictest0-21swapper/219:35:072
18456995912,41cyclictest0-21swapper/222:55:312
18456995912,33cyclictest18799-21chrt17:40:092
18456995910,33cyclictest0-21swapper/220:40:532
18457995740,11cyclictest3381-21cut21:50:073
18457995740,11cyclictest27568-21unixbench_singl17:55:313
1845799573,30cyclictest0-21swapper/322:54:493
18456995722,11cyclictest25559-21runrttasks17:54:342
18456995717,33cyclictest32766-21idleruntime-cro18:09:582
18456995717,33cyclictest32766-21idleruntime-cro18:09:582
18456995713,38cyclictest16960-21chrt18:41:562
18456995710,29cyclictest0-21swapper/221:30:112
18456995619,21cyclictest6267-21cut18:20:162
1845799555,45cyclictest0-21swapper/319:53:233
1845799554,25cyclictest0-21swapper/321:43:083
18456995510,38cyclictest0-21swapper/218:30:202
19282542,10sleep30-21swapper/321:48:333
1845799549,30cyclictest27049-21chrt21:36:303
1845799545,42cyclictest0-21swapper/320:23:343
18457995437,11cyclictest32089-21cpuspeed_turbos19:15:083
1845699544,43cyclictest0-21swapper/218:35:182
1845699542,46cyclictest0-21swapper/219:15:052
18456995413,34cyclictest192481sshd18:45:312
18456995411,30cyclictest0-21swapper/219:23:292
33022533,42sleep30-21swapper/319:20:273
314672533,11sleep30-21swapper/319:14:223
1845799534,43cyclictest0-21swapper/321:05:393
1845799534,35cyclictest0-21swapper/323:05:573
1845799534,33cyclictest0-21swapper/322:18:173
18457995321,25cyclictest17604-21grep20:35:123
18457995314,33cyclictest361ktimersoftd/319:46:103
1845699537,40cyclictest0-21swapper/219:09:552
190072523,41sleep30-21swapper/322:13:563
1845799527,39cyclictest0-21swapper/321:00:243
18457995229,18cyclictest13915-21crond22:54:463
1845699523,30cyclictest0-21swapper/219:10:192
18456995210,35cyclictest5031-21grep19:25:142
1845799515,29cyclictest0-21swapper/318:54:573
1845799515,29cyclictest0-21swapper/318:54:573
1845799514,28cyclictest0-21swapper/320:19:543
1845799514,25cyclictest0-21swapper/320:44:293
18457995134,10cyclictest7477-21gltestperf19:30:133
18457995134,10cyclictest7477-21gltestperf19:30:133
1845799513,26cyclictest0-21swapper/322:40:263
18457995112,33cyclictest18142-21head21:25:013
1845699517,37cyclictest0-21swapper/218:00:172
18456995119,26cyclictest1419-21runrttasks17:45:112
18456995114,29cyclictest0-21swapper/218:25:272
18456995112,24cyclictest24975-21cstates19:00:082
44022503,9sleep34486-21ps18:15:253
1845799504,37cyclictest0-21swapper/320:30:103
1845799504,29cyclictest0-21swapper/322:30:163
1845799504,28cyclictest0-21swapper/319:04:563
1845799504,24cyclictest6648-21diskstats21:55:053
63102492,10sleep30-21swapper/319:28:573
207792492,9sleep30-21swapper/317:44:303
1845799494,30cyclictest0-21swapper/322:21:173
1845799494,28cyclictest0-21swapper/322:00:013
1845799494,27cyclictest0-21swapper/321:34:283
1845799494,27cyclictest0-21swapper/320:54:593
1845799494,27cyclictest0-21swapper/320:54:593
1845799494,26cyclictest0-21swapper/322:29:393
1845799494,26cyclictest0-21swapper/322:29:393
1845799494,26cyclictest0-21swapper/320:50:553
1845799494,22cyclictest0-21swapper/318:25:093
18457994932,11cyclictest11966-21unixbench_multi18:30:313
18457994920,12cyclictest0-21swapper/320:29:533
18457994919,24cyclictest15353-21nscd20:05:253
18457994913,21cyclictest26011-21fschecks_count20:00:113
136042492,10sleep30-21swapper/321:16:403
244642482,39sleep30-21swapper/319:57:513
1845799484,27cyclictest0-21swapper/318:10:213
1845799484,12cyclictest0-21swapper/323:01:083
18457994831,10cyclictest23962-21unixbench_singl18:55:293
18192482,10sleep30-21swapper/320:11:103
18192482,10sleep30-21swapper/320:11:103
1845799474,37cyclictest0-21swapper/320:47:003
1845799474,26cyclictest0-21swapper/321:20:353
1845799474,26cyclictest0-21swapper/319:05:193
1845799474,24cyclictest0-21swapper/318:40:073
18457994731,10cyclictest19587-21crond18:49:563
1845799473,27cyclictest0-21swapper/317:50:183
18457994717,13cyclictest0-21swapper/318:05:103
18457994717,13cyclictest0-21swapper/318:05:103
18457994716,13cyclictest0-21swapper/318:35:073
1845799467,13cyclictest0-21swapper/319:40:063
1845799464,26cyclictest0-21swapper/317:40:003
1845799453,25cyclictest0-21swapper/319:35:173
1845699445,34cyclictest0-21swapper/217:40:002
1845799424,24cyclictest0-21swapper/318:23:313
18457994226,10cyclictest21855-21gltestperf17:45:173
1845599425,12cyclictest0-21swapper/117:40:001
1845799413,11cyclictest0-21swapper/318:00:203
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional