You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-12 - 09:24

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot7s.osadl.org (updated Wed Aug 12, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
258729467,8sleep00-21swapper/019:05:080
257929177,9sleep20-21swapper/219:05:002
442828941,43sleep10-21swapper/119:06:131
468328067,9sleep30-21swapper/319:09:313
480899290,1cyclictest0-21swapper/223:27:442
480899280,28cyclictest0-21swapper/222:07:572
480899280,27cyclictest0-21swapper/221:21:172
480899270,26cyclictest0-21swapper/222:23:152
480899260,1cyclictest0-21swapper/223:22:072
480899250,1cyclictest0-21swapper/223:06:102
4804992522,1cyclictest0-21swapper/121:31:221
480899230,23cyclictest0-21swapper/200:13:272
480899230,0cyclictest0-21swapper/221:41:452
480899230,0cyclictest0-21swapper/200:28:522
480899221,16cyclictest0-21swapper/222:40:352
480899220,22cyclictest0-21swapper/221:57:542
480899220,21cyclictest0-21swapper/221:00:152
480899220,20cyclictest0-21swapper/223:47:262
480899220,20cyclictest0-21swapper/223:44:422
480899220,1cyclictest0-21swapper/200:07:242
480499210,1cyclictest0-21swapper/121:55:001
480899200,20cyclictest0-21swapper/222:56:392
480899200,20cyclictest0-21swapper/200:01:422
480899200,20cyclictest0-21swapper/200:01:422
480899200,17cyclictest0-21swapper/223:32:412
480899191,1cyclictest0-21swapper/222:13:152
480899191,1cyclictest0-21swapper/222:13:152
480899190,17cyclictest0-21swapper/222:25:502
480099190,1cyclictest0-21swapper/021:31:510
480099190,18cyclictest0-21swapper/022:06:080
4810991812,4cyclictest39-21ksoftirqd/322:30:143
4810991810,7cyclictest0-21swapper/321:12:113
480899180,2cyclictest0-21swapper/220:15:222
480899180,2cyclictest0-21swapper/220:15:212
480899180,1cyclictest0-21swapper/223:39:512
480899180,1cyclictest0-21swapper/200:30:012
480899180,14cyclictest0-21swapper/222:32:232
480899180,0cyclictest0-21swapper/221:47:052
480899180,0cyclictest0-21swapper/200:17:152
480099180,18cyclictest0-21swapper/023:58:230
4810991717,0cyclictest0-21swapper/321:33:013
481099170,1cyclictest0-21swapper/323:43:163
4808991710,6cyclictest0-21swapper/222:18:402
480899170,17cyclictest0-21swapper/223:59:142
480899170,16cyclictest0-21swapper/221:25:382
480899170,0cyclictest0-21swapper/222:53:192
480499177,9cyclictest31147-21latency_hist21:30:001
480499171,16cyclictest29810-21diskmemload21:24:211
480499170,16cyclictest0-21swapper/123:21:321
4800991716,1cyclictest0-21swapper/022:12:180
4800991716,1cyclictest0-21swapper/022:12:170
480099171,16cyclictest0-21swapper/021:15:420
480099171,14cyclictest0-21swapper/021:20:380
480099170,16cyclictest0-21swapper/019:10:130
480099170,15cyclictest0-21swapper/022:37:090
481099162,9cyclictest10174-21apt-get22:15:153
481099160,0cyclictest0-21swapper/323:48:543
480899160,16cyclictest0-21swapper/221:17:482
480499163,2cyclictest25-21ksoftirqd/123:00:161
480499160,1cyclictest0-21swapper/121:35:511
480099160,12cyclictest0-21swapper/023:00:120
480099160,11cyclictest0-21swapper/023:35:190
481099153,8cyclictest25265-21apt-get21:00:153
4810991512,1cyclictest0-21swapper/321:36:183
481099150,0cyclictest0-21swapper/322:48:213
4808991511,3cyclictest16795-21wc20:40:182
480499150,13cyclictest22349-21sort19:45:161
480099155,3cyclictest0-21swapper/022:50:130
480099150,15cyclictest0-21swapper/021:38:370
481099143,4cyclictest225-21systemd-journal19:25:133
4810991410,3cyclictest15787-21tr23:35:143
481099140,9cyclictest16666-21cron19:34:593
480899142,1cyclictest0-21swapper/221:50:122
4808991410,3cyclictest23799-21cron19:50:002
4808991410,3cyclictest22784-21sort20:55:012
4808991410,2cyclictest27226-21grep19:55:182
480899140,14cyclictest0-21swapper/223:12:262
480899140,0cyclictest0-21swapper/222:39:062
480899140,0cyclictest0-21swapper/221:33:202
480499145,3cyclictest4585-21apache_accesses22:50:121
4804991411,2cyclictest29810-21diskmemload23:38:561
480499141,12cyclictest29810-21diskmemload22:01:391
4804991411,2cyclictest27029-21grep21:00:281
4804991411,2cyclictest11775-21grep22:35:151
4804991410,3cyclictest13654-21cut22:55:161
480099149,3cyclictest0-21swapper/023:43:530
480099144,6cyclictest31213-21ssh23:25:130
4800991414,0cyclictest0-21swapper/000:33:380
4800991414,0cyclictest0-21swapper/000:21:100
480099141,1cyclictest0-21swapper/019:50:110
480099140,4cyclictest0-21swapper/022:15:200
480099140,11cyclictest9752-21apt-get00:10:130
481099139,3cyclictest6663-21cat23:30:003
481099139,3cyclictest3892-21tr20:15:153
481099139,3cyclictest3892-21tr20:15:153
4810991313,0cyclictest0-21swapper/321:47:433
4810991310,2cyclictest21964-21tr19:45:143
4810991310,2cyclictest16066-21cron23:55:003
480899139,3cyclictest9630-21wc20:25:212
480899139,3cyclictest8407-21wc19:15:202
480899139,3cyclictest28883-21grep22:45:142
480899139,3cyclictest13810-21grep19:25:262
480899133,4cyclictest0-21swapper/219:50:112
4808991310,2cyclictest21503-21wc19:45:002
480899130,0cyclictest0-21swapper/221:35:122
480499138,4cyclictest29059-21ssh21:47:301
480499134,5cyclictest0-21swapper/122:40:121
480499132,7cyclictest6278-31find00:08:551
480499131,5cyclictest0-21swapper/123:55:541
4804991311,1cyclictest0-21swapper/123:46:311
480499131,11cyclictest0-21swapper/100:31:451
4804991310,2cyclictest8491-21tr23:50:151
4804991310,2cyclictest7969-21sed23:30:171
4804991310,2cyclictest6732-21ssh00:27:131
4804991310,2cyclictest31083-21grep23:05:231
4804991310,2cyclictest28756-21basename22:45:141
4804991310,2cyclictest20629-21ps19:40:221
4804991310,2cyclictest14122-21wc21:20:001
480499130,13cyclictest0-21swapper/100:36:401
480099139,3cyclictest13678-21grep22:55:160
480099135,4cyclictest225-21systemd-journal22:00:000
480099134,8cyclictest455-21dbus-daemon00:09:160
480099131,7cyclictest31042-21munin-run21:30:000
4800991313,0cyclictest0-21swapper/023:20:040
4800991313,0cyclictest0-21swapper/021:54:290
4800991312,1cyclictest0-21swapper/022:01:360
4800991310,2cyclictest9114-21sed23:30:260
4800991310,2cyclictest29868-21cat20:00:230
4800991310,2cyclictest16104-21cat23:55:000
480099130,8cyclictest9563-21awk19:20:000
480099130,11cyclictest0-21swapper/000:18:560
481099129,3cyclictest25879-21apache219:50:163
481099129,2cyclictest9977-21grep20:25:243
481099129,2cyclictest7454-21grep19:15:143
481099129,2cyclictest7022-21cat23:10:203
481099129,2cyclictest5797-21head19:10:173
481099129,2cyclictest32009-21grep20:05:253
481099129,2cyclictest31754-21sed23:05:293
481099129,2cyclictest28418-21head21:05:183
481099129,2cyclictest28116-21turbostat22:45:013
481099129,2cyclictest27275-21grep19:55:183
481099129,2cyclictest27091-21cut22:25:113
481099129,2cyclictest25954-21cron00:20:013
481099129,2cyclictest22891-21taskset21:25:023
481099129,2cyclictest2003-21tr22:10:143
481099129,2cyclictest2003-21tr22:10:143
481099129,2cyclictest10221-21grep21:55:213
481099122,0cyclictest0-21swapper/300:05:413
481099121,5cyclictest29810-21diskmemload22:50:143
4810991212,0cyclictest0-21swapper/322:00:073
4810991210,2cyclictest39-21ksoftirqd/323:16:363
480899129,2cyclictest29016-21tr20:00:182
480899129,2cyclictest27293-21grep00:20:172
480899129,2cyclictest21589-21tr23:00:122
480899129,2cyclictest19953-21cut00:35:162
480899129,2cyclictest18034-21grep19:35:202
480899129,2cyclictest15449-21cron20:40:012
480899128,2cyclictest14945-21tail23:15:172
480899126,2cyclictest225-21systemd-journal19:15:002
480899121,2cyclictest0-21swapper/222:02:342
4808991210,1cyclictest18869-21grep20:45:192
480499129,2cyclictest7524-21cut19:15:151
480499129,2cyclictest26239-21sh19:55:001
480499129,2cyclictest25894-21grep00:00:181
480499129,2cyclictest25894-21grep00:00:171
480499129,2cyclictest17186-21grep19:35:151
480499129,2cyclictest10680-21grep21:55:261
480499127,4cyclictest18160-21basename20:45:151
4804991211,1cyclictest0-21swapper/122:05:141
480499120,11cyclictest10702-21cron20:30:001
480499120,11cyclictest0-21swapper/122:16:461
480099129,2cyclictest5036-21grep22:30:280
480099129,2cyclictest26000-21ssh21:45:220
480099129,2cyclictest20950-21grep22:40:160
480099129,2cyclictest19809-21grep20:45:280
480099129,2cyclictest17600-21grep19:35:170
480099129,2cyclictest11745-21head20:30:180
480099129,1cyclictest0-21swapper/023:46:450
480099128,3cyclictest28808-21cut21:05:220
480099125,6cyclictest22005-21munin-run23:19:590
480099120,11cyclictest4062-21grep20:15:160
480099120,11cyclictest4062-21grep20:15:160
156852120,1sleep30-21swapper/322:37:083
481099118,2cyclictest7496-21sh21:54:243
481099118,2cyclictest6997-21sed20:20:173
481099118,2cyclictest4999-21ssh00:25:513
481099118,2cyclictest28665-21ssh22:06:113
481099118,2cyclictest27053-21apt00:40:003
481099118,2cyclictest26309-21ssh00:20:053
481099118,2cyclictest22567-21sh22:21:583
481099118,2cyclictest22375-21ssh23:20:063
481099118,2cyclictest21903-21expr20:50:253
481099118,2cyclictest21823-21ssh21:43:273
481099118,2cyclictest21753-21sh23:57:553
481099118,2cyclictest18533-21ssh22:58:133
481099118,2cyclictest18300-21cpu20:45:153
481099118,2cyclictest17583-21sort19:35:173
481099118,2cyclictest15675-21ssh00:32:373
481099118,2cyclictest14392-21ssh21:20:043
481099118,2cyclictest13275-21ssh00:11:383
481099118,2cyclictest10337-21ssh21:17:043
4810991110,1cyclictest0-21swapper/323:31:283
481099110,10cyclictest24587-21ssh23:01:233
481099110,10cyclictest22977-21cut20:55:143
481099110,0cyclictest0-21swapper/300:01:053
481099110,0cyclictest0-21swapper/300:01:053
480899118,2cyclictest460-21sed20:05:332
480899118,2cyclictest23638-21tail20:55:182
480899118,2cyclictest15815-21wc19:30:212
480899118,2cyclictest1497-21tr20:10:162
480899118,2cyclictest14280-21ssh23:53:362
480899118,2cyclictest11501-21head19:20:272
480899118,2cyclictest11265-21cut20:30:152
480899113,5cyclictest1819-21chrt21:11:552
480499119,2cyclictest4129-21rm21:13:441
480499119,2cyclictest25-21ksoftirqd/122:27:241
480499118,2cyclictest9802-21grep00:10:131
480499118,2cyclictest5176-21grep19:10:141
480499118,2cyclictest4457-21chrt22:11:011
480499118,2cyclictest4457-21chrt22:11:011
480499118,2cyclictest29308-21grep21:05:281
480499118,2cyclictest28980-21grep20:00:181
480499118,2cyclictest27299-21grep00:20:181
480499118,2cyclictest22028-21wc20:50:261
480499118,2cyclictest21998-21ssh21:43:351
480499118,2cyclictest18263-21ssh23:17:061
480499118,2cyclictest1246-21cut20:10:151
480499118,2cyclictest12124-21chrt19:24:591
480499118,1cyclictest29260-21ssh23:43:011
480499117,3cyclictest32424-21grep23:25:211
480499117,2cyclictest18655-21ssh22:20:131
480099119,1cyclictest29830-21strings22:45:190
480099118,2cyclictest9307-21grep20:25:180
480099118,2cyclictest6448-21ssh23:10:170
480099118,2cyclictest30234-21cat23:05:170
480099118,2cyclictest26923-21grep21:00:270
480099118,2cyclictest23734-21cat20:55:190
480099118,2cyclictest22139-21expr19:45:130
480099118,2cyclictest19411-21grep22:20:160
480099118,2cyclictest14628-21wget19:30:140
480099118,2cyclictest1109-21ssh21:11:220
480099110,4cyclictest0-21swapper/000:00:150
480099110,4cyclictest0-21swapper/000:00:140
480099110,2cyclictest0-21swapper/021:42:020
480099110,10cyclictest0-21swapper/000:25:370
481099108,1cyclictest2368-21ntpq20:10:223
481099108,1cyclictest19377-21cut19:40:143
481099108,1cyclictest175882sleep320:41:473
481099108,1cyclictest11803-21taskset19:23:373
481099102,4cyclictest225-21systemd-journal20:01:163
480899106,3cyclictest7736-21wc20:20:262
480899103,4cyclictest28480-21sed21:05:192
480499108,1cyclictest5317-21cat20:15:271
480499108,1cyclictest5317-21cat20:15:271
480499108,1cyclictest165072sleep119:33:061
480499108,1cyclictest15787-21cut20:40:121
480499108,1cyclictest141322sleep119:28:051
480499108,1cyclictest12752-21taskset20:30:541
480499107,2cyclictest6984-21cut20:20:181
480499107,2cyclictest6640-21sed23:10:181
480499107,2cyclictest5526-21ssh22:30:461
480499107,2cyclictest31289-21apache_processe20:05:201
480499107,2cyclictest18155-21ssh00:15:141
480499107,2cyclictest13454-21tr20:35:161
480099108,1cyclictest7062-21basename20:20:180
480099108,1cyclictest580-21uptime20:05:340
480099108,1cyclictest28693-21rm22:25:230
480099108,1cyclictest19411-21cut19:40:140
480099108,1cyclictest19036-21rm00:35:040
480099108,1cyclictest17476-21taskset20:40:250
480099107,2cyclictest26479-21seq19:55:120
480099107,2cyclictest1783-21df20:10:170
480099107,2cyclictest12296-21grep19:25:150
480099100,9cyclictest10962-21ntp_offset19:20:210
48109997,1cyclictest13719-21ls20:35:183
48109997,1cyclictest11957-21wc20:30:203
48049997,1cyclictest28045-21sed19:55:261
48049997,1cyclictest23252-21expr20:55:161
48009997,1cyclictest20719-21expr20:50:150
48009972,3cyclictest13948-21grep20:35:190
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional