You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-25 - 10:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Tue Aug 25, 2026 00:44:20)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1481399280,1cyclictest0-21swapper/022:40:380
1481399270,1cyclictest0-21swapper/023:05:000
1481499261,1cyclictest24743-21diskmemload23:16:581
1481399260,1cyclictest9434-21latency_hist00:05:000
1481399260,1cyclictest32528-21dump-pmu-power23:25:000
1481399260,1cyclictest28840-21ssh22:25:000
1481699250,24cyclictest0-21swapper/300:11:403
1481599250,24cyclictest8429-21diskmemload22:55:352
1481599250,21cyclictest28255-21ssh22:51:092
1481499250,24cyclictest8429-21diskmemload00:17:411
1481399250,24cyclictest8429-21diskmemload21:36:250
1481399250,24cyclictest28056-21ssh21:55:210
1481399250,24cyclictest14047-21ssh21:42:050
1481399250,1cyclictest20284-21sh00:14:130
1481399250,1cyclictest15327-21sh00:10:000
1481399250,0cyclictest0-21swapper/023:27:490
14816992423,1cyclictest0-21swapper/322:13:063
1481699240,23cyclictest8553-21ssh22:05:443
1481699240,23cyclictest8429-21diskmemload21:32:133
1481699240,23cyclictest8429-21diskmemload21:16:033
1481699240,23cyclictest0-21swapper/322:20:353
1481699240,0cyclictest8429-21diskmemload23:02:523
14815992419,4cyclictest0-21swapper/222:13:172
1481599240,24cyclictest0-21swapper/221:23:192
1481599240,23cyclictest8429-21diskmemload22:07:022
1481599240,23cyclictest8429-21diskmemload21:29:422
1481599240,23cyclictest0-21swapper/223:41:262
1481599240,23cyclictest0-21swapper/223:16:152
1481599240,23cyclictest0-21swapper/222:20:382
1481599240,23cyclictest0-21swapper/221:58:262
1481599240,23cyclictest0-21swapper/221:54:292
1481599240,0cyclictest0-21swapper/200:06:132
14814992424,0cyclictest0-21swapper/121:52:061
14814992423,1cyclictest0-21swapper/121:47:301
14814992422,1cyclictest0-21swapper/122:10:151
1481499240,24cyclictest0-21swapper/122:01:181
1481499240,23cyclictest8429-21diskmemload21:40:571
1481499240,23cyclictest0-21swapper/121:55:231
1481499240,0cyclictest8429-21diskmemload22:44:051
1481499240,0cyclictest0-21swapper/123:04:591
14813992422,2cyclictest0-21swapper/023:42:010
14813992421,2cyclictest0-21swapper/022:04:420
1481399240,23cyclictest8429-21diskmemload23:54:170
1481399240,23cyclictest24295-21rm22:48:220
1481399240,23cyclictest16215-21ssh22:13:090
1481399240,23cyclictest0-21swapper/023:14:230
1481399240,23cyclictest0-21swapper/000:33:270
1481399240,21cyclictest19232-21ssh21:46:270
1481399240,1cyclictest4325-21ssh21:34:150
1481399240,1cyclictest21091-21ssh22:17:040
1481399240,0cyclictest8429-21diskmemload00:22:090
1481399240,0cyclictest25856-21ssh21:52:510
1481399240,0cyclictest11420-21ssh21:11:120
1481399240,0cyclictest0-21swapper/022:58:020
14816992323,0cyclictest8429-21diskmemload23:42:323
14816992323,0cyclictest0-21swapper/323:32:573
14816992323,0cyclictest0-21swapper/321:50:103
14816992323,0cyclictest0-21swapper/321:37:353
14816992323,0cyclictest0-21swapper/300:35:093
14816992323,0cyclictest0-21swapper/300:24:453
14816992322,1cyclictest27603-21ssh21:25:393
14816992321,1cyclictest8429-21diskmemload00:05:213
14816992321,1cyclictest28729-21ntp_states23:20:413
14816992321,1cyclictest0-21swapper/320:00:003
14816992320,2cyclictest5654-21ssh22:32:153
14816992320,2cyclictest2895-21sh23:26:093
1481699230,23cyclictest0-21swapper/323:54:213
1481699230,23cyclictest0-21swapper/322:50:003
1481699230,23cyclictest0-21swapper/322:35:153
1481699230,23cyclictest0-21swapper/322:27:183
1481699230,23cyclictest0-21swapper/300:02:183
1481699230,22cyclictest4145-21ssh00:30:233
1481699230,22cyclictest27891-21ssh21:55:093
1481699230,22cyclictest0-21swapper/321:10:213
14815992323,0cyclictest0-21swapper/223:55:222
14815992323,0cyclictest0-21swapper/222:17:172
14815992322,1cyclictest0-21swapper/220:50:002
14815992321,2cyclictest0-21swapper/222:25:542
14815992321,1cyclictest29541-21sh19:40:012
1481599230,23cyclictest0-21swapper/223:48:142
1481599230,23cyclictest0-21swapper/223:12:452
1481599230,23cyclictest0-21swapper/222:31:292
1481599230,23cyclictest0-21swapper/200:15:562
1481599230,22cyclictest8429-21diskmemload00:02:502
1481599230,22cyclictest3687-21ssh22:01:172
1481599230,1cyclictest0-21swapper/221:17:112
1481599230,1cyclictest0-21swapper/200:37:052
1481599230,0cyclictest8429-21diskmemload23:06:502
1481599230,0cyclictest0-21swapper/223:52:182
1481599230,0cyclictest0-21swapper/222:47:032
14814992323,0cyclictest0-21swapper/123:46:031
14814992323,0cyclictest0-21swapper/122:23:071
14814992323,0cyclictest0-21swapper/100:36:521
14814992323,0cyclictest0-21swapper/100:12:301
14814992322,1cyclictest0-21swapper/122:48:031
14814992321,1cyclictest0-21swapper/122:55:081
14814992321,1cyclictest0-21swapper/122:35:241
14814992321,1cyclictest0-21swapper/122:29:021
14814992321,1cyclictest0-21swapper/121:32:561
1481499230,23cyclictest8429-21diskmemload21:35:491
1481499230,23cyclictest0-21swapper/122:51:081
1481499230,23cyclictest0-21swapper/122:05:251
1481499230,23cyclictest0-21swapper/100:07:441
1481499230,22cyclictest9802-21gltestperf21:10:361
1481499230,22cyclictest8429-21diskmemload21:27:561
1481499230,0cyclictest0-21swapper/123:57:061
1481499230,0cyclictest0-21swapper/123:52:411
1481499230,0cyclictest0-21swapper/123:20:091
1481499230,0cyclictest0-21swapper/121:17:381
1481499230,0cyclictest0-21swapper/100:20:111
14813992323,0cyclictest0-21swapper/022:06:170
14813992321,1cyclictest6551-21sh22:33:280
14813992319,4cyclictest0-21swapper/019:15:340
14813992319,3cyclictest0-21swapper/022:35:350
1481399230,23cyclictest0-21swapper/022:52:440
1481399230,23cyclictest0-21swapper/022:25:440
1481399230,23cyclictest0-21swapper/021:17:050
1481399230,22cyclictest22636-21/usr/sbin/munin23:15:380
1481399230,22cyclictest15676-21diskmemload23:38:080
1481399230,22cyclictest13941-21dump-pmu-power20:15:000
1481399230,0cyclictest8429-21diskmemload23:07:190
1481399230,0cyclictest0-21swapper/021:20:170
1481399230,0cyclictest0-21swapper/000:17:220
14816992222,0cyclictest0-21swapper/322:57:193
14816992222,0cyclictest0-21swapper/322:44:043
14816992222,0cyclictest0-21swapper/322:01:083
14816992222,0cyclictest0-21swapper/321:45:063
14816992222,0cyclictest0-21swapper/300:17:263
14816992220,1cyclictest0-21swapper/323:06:023
1481699220,2cyclictest22614-21taskset22:19:163
1481699220,21cyclictest8429-21diskmemload21:20:163
1481699220,21cyclictest23115-21sh23:45:213
1481699220,21cyclictest18812-21cron20:25:013
1481699220,21cyclictest11667-21df_inode21:40:363
1481699220,21cyclictest0-21swapper/322:50:353
1481699220,21cyclictest0-21swapper/320:35:363
1481699220,1cyclictest1154-21ssh23:56:433
1481699220,1cyclictest0-21swapper/323:35:333
14815992222,0cyclictest0-21swapper/221:10:172
1481599221,1cyclictest27143-21sh19:35:002
1481599220,22cyclictest0-21swapper/223:30:282
1481599220,22cyclictest0-21swapper/223:25:102
1481599220,22cyclictest0-21swapper/223:04:572
1481599220,22cyclictest0-21swapper/200:21:292
1481599220,21cyclictest16722-21apt-get20:20:352
1481599220,21cyclictest0-21swapper/222:40:012
1481599220,21cyclictest0-21swapper/221:46:582
1481599220,21cyclictest0-21swapper/200:10:372
1481599220,1cyclictest0-21swapper/223:38:222
14814992222,0cyclictest0-21swapper/100:32:091
14814992220,1cyclictest0-21swapper/123:25:351
1481499220,2cyclictest8429-21diskmemload21:20:371
1481499220,21cyclictest0-21swapper/123:40:561
1481499220,21cyclictest0-21swapper/123:31:261
1481499220,21cyclictest0-21swapper/123:10:191
1481499220,21cyclictest0-21swapper/121:05:351
1481499220,21cyclictest0-21swapper/100:25:121
1481499220,21cyclictest0-21swapper/100:00:061
1481499220,1cyclictest31954-21latency_hist19:45:011
1481499220,1cyclictest2499-21ssh22:30:181
1481499220,1cyclictest20264-21apt-get19:20:351
1481499220,0cyclictest0-21swapper/122:16:011
14813992221,1cyclictest0-21swapper/023:57:440
14813992220,1cyclictest28803-21cron20:45:000
14813992218,4cyclictest0-21swapper/020:35:350
1481399220,21cyclictest9623-21ssh00:35:100
1481399220,21cyclictest0-21swapper/023:45:100
1481399220,1cyclictest0-21swapper/021:25:180
14816992121,0cyclictest0-21swapper/323:13:003
1481699210,20cyclictest24014-21wc20:35:013
1481699210,20cyclictest21778-21ssh23:15:123
1481699210,20cyclictest0-21swapper/319:25:353
14815992121,0cyclictest0-21swapper/223:20:132
14815992121,0cyclictest0-21swapper/220:55:352
14815992120,1cyclictest0-21swapper/221:35:072
14815992119,2cyclictest0-21swapper/221:30:062
14815992119,1cyclictest22657-21apt-get19:25:342
14815992119,1cyclictest22350-21turbostat19:25:002
14815992118,2cyclictest8433-21cron21:10:012
14815992118,2cyclictest17147-21apt-get19:15:002
14815992117,3cyclictest1950-21dump-pmu-power19:50:012
1481599210,21cyclictest8429-21diskmemload00:25:142
1481599210,21cyclictest0-21swapper/200:30:532
1481599210,20cyclictest13427-21sh21:41:192
1481599210,20cyclictest0-21swapper/221:00:342
1481599210,20cyclictest0-21swapper/220:35:012
1481599210,1cyclictest21205-21dump-pmu-power20:30:012
1481599210,0cyclictest75-21kswapd022:35:022
1481599210,0cyclictest0-21swapper/220:35:352
14814992121,0cyclictest8429-21diskmemload23:35:141
14814992120,0cyclictest0-21swapper/119:45:351
14814992119,1cyclictest0-21swapper/120:10:001
1481499210,21cyclictest0-21swapper/120:00:351
1481499210,20cyclictest0-21swapper/119:55:341
1481499210,20cyclictest0-21swapper/119:15:021
1481499210,0cyclictest0-21swapper/120:55:341
1481499210,0cyclictest0-21swapper/119:35:331
1481399210,21cyclictest0-21swapper/020:30:350
1481399210,1cyclictest0-21swapper/019:35:350
1481399210,0cyclictest3957-21apt-get21:00:340
14816992020,0cyclictest0-21swapper/320:10:353
14815992019,0cyclictest2244-21apt-get19:50:352
14815992017,2cyclictest11550-21cron20:10:002
14814992017,2cyclictest18822-21turbostat20:25:011
1481499200,0cyclictest0-21swapper/120:47:311
14813992020,0cyclictest29114-21apt-get20:45:350
14813992020,0cyclictest0-21swapper/020:20:350
1481399200,1cyclictest0-21swapper/019:55:400
1481399200,0cyclictest0-21swapper/020:05:380
1481399200,0cyclictest0-21swapper/019:30:350
14816991919,0cyclictest6355-21apt-get21:05:353
14816991919,0cyclictest0-21swapper/320:50:343
14816991919,0cyclictest0-21swapper/319:30:353
14815991919,0cyclictest0-21swapper/219:55:342
14815991917,1cyclictest1246-21grep20:55:002
14814991917,1cyclictest0-21swapper/121:05:001
14813991919,0cyclictest31556-21apt-get20:50:350
14813991917,1cyclictest16400-21dump-pmu-power20:20:000
1481399190,1cyclictest7063-21apt-get20:00:350
1481399190,1cyclictest0-21swapper/019:10:360
14816991818,0cyclictest0-21swapper/319:40:343
14816991818,0cyclictest0-21swapper/319:15:343
14816991817,1cyclictest27450-21apt-get19:35:333
14816991816,1cyclictest6066-21munin-run21:05:003
14816991816,1cyclictest0-21swapper/319:25:003
14815991818,0cyclictest0-21swapper/219:40:342
14814991818,0cyclictest0-21swapper/119:10:341
14814991816,1cyclictest24304-21apt-get20:35:361
1481399181,16cyclictest3635-21swap19:50:430
1481399180,17cyclictest0-21swapper/019:20:350
1481399180,0cyclictest0-21swapper/021:05:370
14816991717,0cyclictest0-21swapper/319:10:343
14816991716,1cyclictest31263-21ls20:50:003
1481699170,16cyclictest0-21swapper/320:15:353
14814991717,0cyclictest0-21swapper/120:25:351
14814991716,0cyclictest28806-21turbostat20:45:001
14816991616,0cyclictest0-21swapper/319:50:353
14815991616,0cyclictest17147-21apt-get19:15:022
14815991616,0cyclictest0-21swapper/220:15:342
14814991616,0cyclictest0-21swapper/119:50:351
14814991614,1cyclictest11848-21apt-get20:10:351
14813991616,0cyclictest0-21swapper/020:25:350
14813991616,0cyclictest0-21swapper/019:40:340
14816991515,0cyclictest0-21swapper/319:45:353
14816991514,1cyclictest0-21swapper/320:40:393
1481699150,14cyclictest0-21swapper/320:00:363
14814991515,0cyclictest0-21swapper/119:30:351
1481499150,14cyclictest0-21swapper/120:50:341
14813991515,0cyclictest0-21swapper/019:25:350
14816991414,0cyclictest0-21swapper/320:55:233
1481699140,14cyclictest0-21swapper/320:25:323
1481699140,14cyclictest0-21swapper/320:07:213
14815991414,0cyclictest0-21swapper/220:42:222
14815991414,0cyclictest0-21swapper/220:10:032
1481599140,14cyclictest0-21swapper/220:00:052
1481399140,0cyclictest0-21swapper/020:55:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional