You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-13 - 05:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot5s.osadl.org (updated Mon Apr 13, 2026 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
783999280,0cyclictest0-21swapper/021:39:300
784499270,0cyclictest0-21swapper/121:39:301
783999270,23cyclictest2658-21diskmemload22:18:000
783999270,0cyclictest0-21swapper/021:29:280
7844992624,1cyclictest0-21swapper/123:22:321
784499260,1cyclictest22849-21perl23:04:301
7839992622,4cyclictest0-21swapper/020:14:280
7839992620,5cyclictest0-21swapper/021:24:280
7844992521,3cyclictest6035-21apt-get20:14:281
7844992520,4cyclictest15944-21apt-get21:24:281
784499250,24cyclictest15409-21apt-get23:29:281
784499250,21cyclictest0-21swapper/123:39:471
7839992522,3cyclictest2658-21diskmemload00:10:290
783999250,24cyclictest0-21swapper/021:47:390
783999250,21cyclictest6904-21apt-get22:49:280
783999250,21cyclictest0-21swapper/023:30:400
783999250,1cyclictest0-21swapper/022:28:590
785499240,24cyclictest0-21swapper/322:23:223
785499240,23cyclictest605-21avahi-daemon19:40:003
785499240,23cyclictest2658-21diskmemload00:39:543
785499240,23cyclictest2658-21diskmemload00:22:183
7846992419,4cyclictest0-21swapper/200:00:412
784699240,23cyclictest2658-21diskmemload21:49:532
784699240,23cyclictest0-21swapper/221:55:332
784699240,1cyclictest2658-21diskmemload21:28:412
7844992421,2cyclictest13498-21sh21:53:191
7844992420,4cyclictest0-21swapper/121:09:291
7844992420,3cyclictest0-21swapper/121:58:101
7844992420,3cyclictest0-21swapper/100:36:561
784499240,2cyclictest18881-21ssh21:25:551
784499240,23cyclictest0-21swapper/122:41:221
784499240,23cyclictest0-21swapper/100:22:461
784499240,23cyclictest0-21swapper/100:01:271
784499240,21cyclictest0-21swapper/123:30:401
784499240,21cyclictest0-21swapper/122:28:591
784499240,21cyclictest0-21swapper/121:46:141
784499240,0cyclictest0-21swapper/122:38:321
784499240,0cyclictest0-21swapper/122:18:191
784499240,0cyclictest0-21swapper/100:26:191
7839992423,1cyclictest9764-21ssh22:50:460
7839992423,1cyclictest62550irq/127-eno121:16:340
7839992423,1cyclictest0-21swapper/023:58:510
7839992421,2cyclictest27227-21grep21:34:320
7839992420,3cyclictest0-21swapper/020:44:300
7839992419,4cyclictest0-21swapper/023:44:300
783999240,24cyclictest0-21swapper/023:09:230
783999240,24cyclictest0-21swapper/000:01:270
783999240,23cyclictest19881-21ssh23:00:360
783999240,23cyclictest0-21swapper/000:35:290
783999240,23cyclictest0-21swapper/000:05:540
783999240,20cyclictest0-21swapper/022:13:360
7854992323,0cyclictest0-21swapper/323:31:543
7854992323,0cyclictest0-21swapper/323:26:523
7854992323,0cyclictest0-21swapper/323:13:013
7854992323,0cyclictest0-21swapper/322:41:583
7854992323,0cyclictest0-21swapper/321:29:343
7854992321,1cyclictest11190-21sh22:53:093
7854992320,2cyclictest17451-21ssh21:56:233
785499230,23cyclictest2658-21diskmemload23:16:233
785499230,23cyclictest2658-21diskmemload00:27:143
785499230,23cyclictest0-21swapper/322:33:283
785499230,22cyclictest6947-21rm21:46:033
785499230,0cyclictest0-21swapper/323:59:383
785499230,0cyclictest0-21swapper/322:00:113
785499230,0cyclictest0-21swapper/321:50:593
785499230,0cyclictest0-21swapper/321:33:483
7846992323,0cyclictest2658-21diskmemload22:57:212
7846992323,0cyclictest25006-21ssh23:05:342
7846992323,0cyclictest0-21swapper/223:50:292
7846992323,0cyclictest0-21swapper/223:45:212
7846992323,0cyclictest0-21swapper/221:31:102
7846992323,0cyclictest0-21swapper/220:54:282
7846992322,1cyclictest2658-21diskmemload00:15:542
7846992321,1cyclictest0-21swapper/223:39:042
7846992321,1cyclictest0-21swapper/222:16:482
7846992320,2cyclictest11620-21ssh23:56:192
784699230,23cyclictest0-21swapper/200:37:212
784699230,22cyclictest31653-21ssh22:40:202
784699230,22cyclictest30613-21ssh23:11:242
784699230,22cyclictest2658-21diskmemload00:13:002
784699230,22cyclictest22629-21cron23:35:002
784699230,22cyclictest1277-21ssh22:12:102
784699230,22cyclictest1258-21ssh21:40:072
784699230,22cyclictest12151-21cpuspeed22:54:292
784699230,0cyclictest28442-21ssh22:07:352
784699230,0cyclictest2658-21diskmemload00:21:412
7844992323,0cyclictest0-21swapper/123:13:151
7844992323,0cyclictest0-21swapper/122:04:291
7844992323,0cyclictest0-21swapper/121:43:151
7844992321,2cyclictest0-21swapper/100:10:291
7844992320,3cyclictest0-21swapper/123:09:231
7844992320,2cyclictest21305-21apt-get20:44:301
7844992319,3cyclictest0-21swapper/122:07:231
784499230,2cyclictest15578-21sh22:57:021
784499230,23cyclictest0-21swapper/100:31:241
784499230,22cyclictest2658-21diskmemload22:30:431
784499230,22cyclictest0-21swapper/120:04:281
784499230,1cyclictest0-21swapper/122:50:281
7839992323,0cyclictest0-21swapper/021:43:150
7839992321,1cyclictest2675-21cron21:10:000
7839992320,3cyclictest62550irq/127-eno123:35:160
7839992320,2cyclictest0-21swapper/022:07:230
783999230,2cyclictest19332-21turbostat.cron23:00:000
783999230,22cyclictest5347-21ssh00:21:290
783999230,22cyclictest26641-21ssh22:36:090
783999230,22cyclictest0-21swapper/023:50:200
783999230,22cyclictest0-21swapper/023:13:550
783999230,1cyclictest0-21swapper/020:04:280
783999230,0cyclictest2658-21diskmemload21:52:270
783999230,0cyclictest2658-21diskmemload00:26:190
783999230,0cyclictest0-21swapper/022:41:220
783999230,0cyclictest0-21swapper/000:31:240
7854992222,0cyclictest0-21swapper/321:13:123
7854992222,0cyclictest0-21swapper/300:15:313
7854992222,0cyclictest0-21swapper/300:12:143
7854992221,1cyclictest0-21swapper/300:05:293
7854992220,1cyclictest5447-21idleruntime-cro20:10:013
7854992220,1cyclictest32652-21wc20:00:013
7854992220,1cyclictest29311-21ssh23:42:123
785499220,22cyclictest0-21swapper/322:55:103
785499220,22cyclictest0-21swapper/322:11:113
785499220,22cyclictest0-21swapper/321:23:083
785499220,21cyclictest7311-21sh22:18:383
785499220,21cyclictest5447-21ssh22:47:063
785499220,21cyclictest2680-21turbostat21:10:003
785499220,21cyclictest2658-21diskmemload22:36:193
785499220,21cyclictest2658-21diskmemload22:25:123
785499220,21cyclictest24212-21sh23:37:093
785499220,21cyclictest0-21swapper/323:46:403
785499220,21cyclictest0-21swapper/323:20:393
785499220,21cyclictest0-21swapper/321:40:023
785499220,21cyclictest0-21swapper/321:15:563
785499220,1cyclictest0-21swapper/323:50:323
785499220,1cyclictest0-21swapper/320:30:023
785499220,1cyclictest0-21swapper/300:00:443
785499220,0cyclictest0-21swapper/323:03:343
7846992222,0cyclictest0-21swapper/222:00:022
7846992222,0cyclictest0-21swapper/221:16:032
7846992222,0cyclictest0-21swapper/221:11:222
7846992221,1cyclictest0-21swapper/222:30:272
7846992220,1cyclictest0-21swapper/223:40:052
7846992220,1cyclictest0-21swapper/223:17:412
7846992220,1cyclictest0-21swapper/222:20:312
7846992220,0cyclictest0-21swapper/221:37:402
784699220,22cyclictest2658-21diskmemload23:26:372
784699220,21cyclictest2658-21diskmemload23:20:262
784699220,21cyclictest26308-21ssh22:35:332
784699220,21cyclictest22665-21ssh00:07:312
784699220,21cyclictest15595-21ssh00:31:282
784699220,21cyclictest12027-21ssh00:29:022
784699220,21cyclictest0-21swapper/222:26:472
784699220,1cyclictest12646-21apt-get20:25:002
784699220,1cyclictest11793-21sh21:50:362
784699220,1cyclictest0-21swapper/220:05:022
784699220,1cyclictest0-21swapper/219:59:272
7844992222,0cyclictest0-21swapper/121:16:151
7844992221,1cyclictest10695-21ssh22:20:551
784499220,2cyclictest7762-21awk21:15:001
784499220,22cyclictest24986-21ssh21:32:331
784499220,21cyclictest2658-21diskmemload23:15:021
784499220,1cyclictest0-21swapper/119:19:261
784499220,0cyclictest0-21swapper/100:15:411
7839992222,0cyclictest2658-21diskmemload23:15:310
7839992222,0cyclictest0-21swapper/021:58:410
7839992220,2cyclictest0-21swapper/023:20:220
7839992220,1cyclictest28071-21dpkg19:50:020
7839992220,1cyclictest21334-21sh22:30:500
783999220,22cyclictest0-21swapper/022:20:550
783999220,21cyclictest2658-21diskmemload23:45:210
783999220,21cyclictest0-21swapper/021:11:440
783999220,1cyclictest31502-21ssh00:15:140
783999220,1cyclictest18073-21apt-get19:30:020
783999220,1cyclictest0-21swapper/022:03:010
783999220,1cyclictest0-21swapper/020:49:280
783999220,0cyclictest30842-21apt-get19:59:270
7854992121,0cyclictest0-21swapper/320:59:283
7854992120,1cyclictest0-21swapper/321:35:313
7854992119,1cyclictest15185-21ssh00:30:523
785499210,20cyclictest0-21swapper/320:44:303
785499210,1cyclictest1-21systemd20:20:003
785499210,0cyclictest0-21swapper/319:19:273
7846992119,1cyclictest20690-21grep20:40:012
7846992119,1cyclictest0-21swapper/219:30:022
784699210,21cyclictest0-21swapper/223:01:322
784699210,20cyclictest0-21swapper/219:14:262
784699210,1cyclictest16432-21apt-get20:34:272
7844992121,0cyclictest2658-21diskmemload00:05:091
7844992121,0cyclictest0-21swapper/120:59:281
7844992121,0cyclictest0-21swapper/120:24:291
7844992118,2cyclictest20672-21apt20:40:011
784499210,20cyclictest0-21swapper/119:30:021
784499210,0cyclictest8395-21apt-get19:14:261
784499210,0cyclictest0-21swapper/123:45:231
784499210,0cyclictest0-21swapper/120:09:281
7839992120,0cyclictest25657-21apt-get19:49:280
7839992120,0cyclictest10858-21apt-get20:24:300
783999210,20cyclictest10792-21apt-get19:19:270
783999210,0cyclictest0-21swapper/021:04:280
7854992019,0cyclictest0-21swapper/319:24:273
785499200,0cyclictest0-21swapper/320:49:283
785499200,0cyclictest0-21swapper/319:30:003
7846992020,0cyclictest0-21swapper/221:04:282
7846992019,1cyclictest23695-21apt-get20:49:282
7846992019,1cyclictest13269-21apt-get20:25:022
7846992019,0cyclictest0-21swapper/220:59:282
7846992018,1cyclictest22661-21perf19:40:002
7844992020,0cyclictest0-21swapper/119:59:271
7839992018,1cyclictest30302-21perf21:00:010
7839992018,1cyclictest20676-21cron20:40:010
7839992018,1cyclictest17464-21idleruntime-cro19:30:000
7854991919,0cyclictest0-21swapper/320:24:293
7854991917,1cyclictest17438-21apt-get19:30:023
7846991919,0cyclictest8438-21apt-get20:19:282
7846991919,0cyclictest0-21swapper/220:04:282
7844991919,0cyclictest0-21swapper/119:50:021
7844991919,0cyclictest0-21swapper/119:49:281
7844991918,0cyclictest15425-21apt-get20:30:021
7844991917,1cyclictest17438-21apt-get19:30:001
7839991919,0cyclictest0-21swapper/020:09:280
7839991918,1cyclictest10196-21perf19:15:010
7854991818,0cyclictest0-21swapper/320:39:283
7854991816,1cyclictest0-21swapper/320:55:013
7854991816,1cyclictest0-21swapper/320:30:003
7846991818,0cyclictest0-21swapper/219:24:272
7844991818,0cyclictest0-21swapper/120:49:281
7844991818,0cyclictest0-21swapper/120:19:281
7844991817,0cyclictest12646-21apt-get20:25:021
7839991818,0cyclictest0-21swapper/020:30:020
7839991818,0cyclictest0-21swapper/020:19:280
7839991817,1cyclictest20848-21apt-get19:39:290
7854991717,0cyclictest0-21swapper/320:05:013
7854991717,0cyclictest0-21swapper/319:14:263
7854991716,1cyclictest7806-21cron20:15:003
7854991716,1cyclictest30900-21apt-get21:04:283
7846991717,0cyclictest0-21swapper/221:09:292
7844991717,0cyclictest0-21swapper/119:39:291
784499170,1cyclictest27896-21perf20:55:011
7839991717,0cyclictest0-21swapper/020:25:020
7839991714,2cyclictest0-21swapper/020:55:010
7846991616,0cyclictest23266-21apt-get19:44:292
7839991616,0cyclictest0-21swapper/019:44:290
7839991614,1cyclictest0-21swapper/019:24:320
7854991515,0cyclictest0-21swapper/319:49:283
7846991515,0cyclictest0-21swapper/220:44:302
784499150,15cyclictest0-21swapper/121:02:271
784499150,0cyclictest0-21swapper/119:43:501
7854991414,0cyclictest0-21swapper/319:50:023
785499140,14cyclictest0-21swapper/319:40:543
7846991414,0cyclictest0-21swapper/219:47:132
784699140,14cyclictest0-21swapper/220:10:542
784699140,14cyclictest0-21swapper/219:52:472
784699140,14cyclictest0-21swapper/219:25:012
784699140,0cyclictest0-21swapper/219:18:292
784499140,0cyclictest0-21swapper/119:20:251
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional