You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-05 - 05:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sun Jul 05, 2026 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2102899253,21cyclictest14230-21diskmemload00:36:553
2102899250,24cyclictest15685-21ssh22:08:183
2102899250,24cyclictest14230-21diskmemload00:31:403
2102899250,24cyclictest0-21swapper/322:26:293
2102899250,1cyclictest20483-21apt-get23:11:203
21023992523,1cyclictest0-21swapper/222:44:552
2102399250,24cyclictest0-21swapper/221:44:122
2102399250,1cyclictest28789-21ssh21:21:322
2102199250,24cyclictest14230-21diskmemload00:36:071
2102199250,24cyclictest0-21swapper/123:40:321
2102199250,24cyclictest0-21swapper/121:40:061
2101799250,25cyclictest18031-21ssh23:08:170
21028992422,1cyclictest8552-21apt-get19:51:223
2102899240,23cyclictest24405-21sh23:42:563
2102899240,23cyclictest14230-21diskmemload22:00:363
2102899240,23cyclictest12804-21rm00:01:323
2102899240,1cyclictest0-21swapper/322:56:583
2102899240,0cyclictest0-21swapper/321:31:503
21023992423,1cyclictest14698-21cron23:35:012
21023992423,1cyclictest0-21swapper/222:51:522
21023992423,1cyclictest0-21swapper/221:37:582
2102399240,23cyclictest0-21swapper/222:25:232
2102399240,23cyclictest0-21swapper/221:10:262
2102399240,23cyclictest0-21swapper/200:33:532
2102399240,22cyclictest0-21swapper/221:59:352
2102399240,1cyclictest14230-21diskmemload00:28:302
2102399240,1cyclictest14230-21diskmemload00:01:442
21021992424,0cyclictest0-21swapper/100:32:331
21021992421,2cyclictest23388-21turbostat.cron19:15:001
21021992421,2cyclictest15962-21cron21:40:001
2102199240,24cyclictest0-21swapper/100:18:101
2102199240,23cyclictest3379-21sendmail19:40:011
2102199240,23cyclictest14230-21diskmemload23:12:511
2102199240,23cyclictest0-21swapper/121:28:261
2102199240,1cyclictest0-21swapper/100:05:431
2102199240,0cyclictest14230-21diskmemload23:39:261
21017992424,0cyclictest0-21swapper/022:46:110
2101799240,2cyclictest6278-21perl23:56:240
2101799240,24cyclictest0-21swapper/021:31:450
2101799240,24cyclictest0-21swapper/000:11:150
2101799240,23cyclictest11343-21sh21:36:020
2101799240,1cyclictest6967-21ssh23:27:040
2101799240,0cyclictest14230-21diskmemload22:05:160
21028992323,0cyclictest14230-21diskmemload23:35:133
21028992323,0cyclictest14230-21diskmemload21:57:353
21028992322,1cyclictest19854-21perl22:41:253
21028992321,1cyclictest14968-21ssh21:10:373
21028992321,1cyclictest14230-21diskmemload21:17:553
21028992321,1cyclictest0-21swapper/323:25:123
21028992321,1cyclictest0-21swapper/300:16:343
2102899231,21cyclictest14230-21diskmemload21:40:363
2102899230,23cyclictest14230-21diskmemload22:47:073
2102899230,23cyclictest0-21swapper/323:58:363
2102899230,23cyclictest0-21swapper/322:37:343
2102899230,23cyclictest0-21swapper/321:50:363
2102899230,23cyclictest0-21swapper/300:28:083
2102899230,22cyclictest9442-21ssh23:30:123
2102899230,22cyclictest32156-21ssh21:25:143
2102899230,22cyclictest30170-21taskset22:50:503
2102899230,22cyclictest23270-21irqstats00:11:263
2102899230,22cyclictest18279-21ssh23:08:363
2102899230,1cyclictest0-21swapper/322:33:213
2102899230,0cyclictest0-21swapper/321:21:383
21023992323,0cyclictest0-21swapper/223:21:072
21023992323,0cyclictest0-21swapper/223:15:582
21023992323,0cyclictest0-21swapper/223:12:532
21023992323,0cyclictest0-21swapper/223:05:062
21023992321,1cyclictest24329-21hddtemp_smartct22:16:252
21023992321,1cyclictest0-21swapper/223:54:112
21023992321,1cyclictest0-21swapper/200:20:442
2102399230,2cyclictest9474-21awk21:00:012
2102399230,23cyclictest0-21swapper/221:16:382
2102399230,23cyclictest0-21swapper/200:35:112
2102399230,22cyclictest32341-21ssh21:54:392
2102399230,22cyclictest20229-21basename20:15:012
2102399230,22cyclictest14230-21diskmemload23:41:372
2102399230,22cyclictest12542-21apt22:06:222
2102399230,22cyclictest0-21swapper/223:36:372
2102399230,22cyclictest0-21swapper/222:11:252
2102399230,22cyclictest0-21swapper/221:45:192
2102399230,22cyclictest0-21swapper/221:45:192
2102399230,1cyclictest0-21swapper/222:36:362
2102399230,0cyclictest0-21swapper/222:32:092
2102399230,0cyclictest0-21swapper/222:04:512
21021992321,1cyclictest22683-21basename20:20:011
21021992321,1cyclictest0-21swapper/123:01:331
21021992321,1cyclictest0-21swapper/122:35:451
21021992321,1cyclictest0-21swapper/100:20:221
21021992320,2cyclictest32278-21basename20:40:001
21021992320,2cyclictest31597-21sh23:21:181
21021992320,2cyclictest28072-21ssh21:50:581
21021992320,2cyclictest26212-21ssh23:45:101
21021992320,2cyclictest14230-21diskmemload21:17:151
2102199230,23cyclictest0-21swapper/123:26:231
2102199230,23cyclictest0-21swapper/122:06:381
2102199230,23cyclictest0-21swapper/121:10:511
2102199230,22cyclictest9725-21ssh21:33:561
2102199230,22cyclictest23609-21/usr/sbin/munin22:16:251
2102199230,22cyclictest2023-21ssh22:54:301
2102199230,22cyclictest18492-21ssh22:40:121
2102199230,22cyclictest14230-21diskmemload22:56:231
2102199230,22cyclictest0-21swapper/122:21:281
2102199230,22cyclictest0-21swapper/122:00:011
2102199230,1cyclictest151rcu_preempt23:55:201
2102199230,1cyclictest14822-21ssh00:03:431
2102199230,0cyclictest0-21swapper/123:15:561
2102199230,0cyclictest0-21swapper/122:34:551
21017992323,0cyclictest25196-21ssh23:15:170
21017992323,0cyclictest14230-21diskmemload22:03:540
21017992323,0cyclictest0-21swapper/022:15:320
21017992323,0cyclictest0-21swapper/021:45:200
21017992323,0cyclictest0-21swapper/021:45:200
21017992322,1cyclictest738-21ssh21:55:230
21017992322,1cyclictest14230-21diskmemload23:42:180
21017992322,1cyclictest14230-21diskmemload22:24:300
21017992322,1cyclictest14230-21diskmemload00:34:050
2101799230,23cyclictest325-21ssh21:26:120
2101799230,23cyclictest14230-21diskmemload22:58:020
2101799230,23cyclictest14230-21diskmemload22:25:460
2101799230,23cyclictest0-21swapper/022:31:490
2101799230,23cyclictest0-21swapper/021:24:590
2101799230,23cyclictest0-21swapper/000:07:580
2101799230,22cyclictest15039-21ssh23:35:090
2101799230,0cyclictest14230-21diskmemload22:10:510
2101799230,0cyclictest14230-21diskmemload00:19:210
2101799230,0cyclictest0-21swapper/021:10:280
2101799230,0cyclictest0-21swapper/020:01:220
2101799230,0cyclictest0-21swapper/000:35:580
21028992222,0cyclictest14230-21diskmemload00:05:283
21028992222,0cyclictest0-21swapper/323:48:353
21028992222,0cyclictest0-21swapper/322:22:003
21028992222,0cyclictest0-21swapper/320:56:243
21028992221,1cyclictest14230-21diskmemload23:01:243
21028992220,1cyclictest0-21swapper/323:21:243
21028992220,1cyclictest0-21swapper/321:35:283
2102899220,21cyclictest612-21ssh00:20:543
2102899220,21cyclictest29865-21munin-run20:35:003
2102899220,21cyclictest19016-21ssh22:11:263
2102899220,21cyclictest0-21swapper/321:06:213
2102899220,1cyclictest31710-21sh23:50:103
21023992222,0cyclictest14230-21diskmemload22:55:502
21023992222,0cyclictest0-21swapper/222:45:492
21023992220,1cyclictest27461-21sleep20:30:012
21023992220,1cyclictest0-21swapper/223:55:142
21023992220,1cyclictest0-21swapper/223:00:112
2102399220,22cyclictest0-21swapper/200:10:452
2102399220,21cyclictest30211-21apt-get20:36:212
2102399220,21cyclictest14230-21diskmemload21:30:062
2102399220,21cyclictest0-21swapper/222:20:352
2102399220,21cyclictest0-21swapper/219:21:222
2102399220,21cyclictest0-21swapper/200:17:042
2102399220,21cyclictest0-21swapper/200:06:572
2102399220,1cyclictest4799-21apt-get23:26:232
2102399220,1cyclictest0-21swapper/223:45:482
2102399220,1cyclictest0-21swapper/221:25:132
21021992222,0cyclictest0-21swapper/121:23:101
21021992221,1cyclictest10221-21ssh23:31:201
21021992221,0cyclictest0-21swapper/119:56:221
21021992220,1cyclictest22424-21sh21:45:531
21021992220,1cyclictest22424-21sh21:45:531
21021992220,1cyclictest0-21swapper/123:51:161
2102199220,22cyclictest2253-21sh22:26:171
2102199220,22cyclictest0-21swapper/123:05:401
2102199220,22cyclictest0-21swapper/120:06:221
2102199220,21cyclictest28826-21apt-get19:25:021
2102199220,21cyclictest12213-21apt-get21:06:211
2102199220,21cyclictest0-21swapper/100:25:181
2102199220,1cyclictest22430-21apt-get00:11:221
2102199220,1cyclictest0-21swapper/122:14:341
2102199220,1cyclictest0-21swapper/119:31:231
21017992222,0cyclictest14230-21diskmemload23:01:400
21017992222,0cyclictest0-21swapper/023:33:050
21017992222,0cyclictest0-21swapper/023:22:580
21017992222,0cyclictest0-21swapper/021:41:070
21017992221,1cyclictest0-21swapper/023:52:460
21017992221,1cyclictest0-21swapper/023:45:230
21017992221,1cyclictest0-21swapper/023:11:020
21017992221,1cyclictest0-21swapper/000:24:280
21017992220,1cyclictest14259-21grep21:10:010
21017992220,1cyclictest12969-21cron20:00:000
2101799220,22cyclictest18996-21ssh22:40:500
2101799220,21cyclictest29897-21sh22:50:300
2101799220,21cyclictest15678-21sh22:36:420
2101799220,21cyclictest10533-21ssh00:00:100
2101799220,1cyclictest29840-21awk20:35:000
2101799220,1cyclictest27573-21ssh21:50:210
2101799220,1cyclictest20545-21ssh21:15:200
21028992119,1cyclictest3408-21munin-run19:40:013
21028992119,1cyclictest32234-21cron20:40:003
2102899210,20cyclictest26172-21apt-get19:21:223
2102899210,20cyclictest0-21swapper/321:01:223
2102899210,20cyclictest0-21swapper/321:01:223
2102899210,0cyclictest0-21swapper/322:15:043
21023992119,2cyclictest31013-21awk19:30:012
21023992119,1cyclictest0-21swapper/219:55:002
2102399210,20cyclictest9821-21apt-get21:01:222
2102399210,20cyclictest9821-21apt-get21:01:222
2102399210,20cyclictest23754-21apt-get19:16:222
2102199210,1cyclictest27818-21apt-get20:31:241
2102199210,1cyclictest0-21swapper/120:50:001
2102199210,0cyclictest0-21swapper/120:11:231
21017992121,0cyclictest7405-21apt-get20:56:230
21017992119,1cyclictest3397-21perf19:40:010
2101799210,0cyclictest0-21swapper/020:21:220
21028992020,0cyclictest0-21swapper/320:21:223
21028992020,0cyclictest0-21swapper/319:11:213
21028992019,0cyclictest18204-21apt-get20:11:233
21028992017,2cyclictest4634-21dump-pmu-power20:50:003
21023992019,1cyclictest0-21swapper/220:41:212
2102399200,0cyclictest15755-21apt-get20:06:222
21021992020,0cyclictest25420-21apt-get20:26:221
21021992020,0cyclictest0-21swapper/119:51:221
21021992018,1cyclictest7019-21cron20:55:001
2102199200,0cyclictest0-21swapper/119:41:221
21017992020,0cyclictest0-21swapper/021:01:220
21017992020,0cyclictest0-21swapper/021:01:220
21017992020,0cyclictest0-21swapper/019:25:020
2101799200,20cyclictest0-21swapper/020:36:210
2101799200,0cyclictest0-21swapper/020:06:210
21028991919,0cyclictest10947-21apt-get19:56:223
21028991919,0cyclictest0-21swapper/320:01:223
21028991919,0cyclictest0-21swapper/319:16:223
21023991919,0cyclictest20596-21apt-get20:16:212
21023991918,0cyclictest0-21swapper/219:31:232
21021991919,0cyclictest0-21swapper/120:56:231
21021991919,0cyclictest0-21swapper/119:46:211
21017991918,0cyclictest0-21swapper/020:11:230
21028991818,0cyclictest0-21swapper/320:51:223
21028991818,0cyclictest0-21swapper/319:41:223
21023991818,0cyclictest0-21swapper/220:51:232
21023991818,0cyclictest0-21swapper/220:46:212
21023991818,0cyclictest0-21swapper/220:31:242
21023991817,1cyclictest23026-21apt-get20:21:222
21021991818,0cyclictest0-21swapper/119:21:211
21021991818,0cyclictest0-21swapper/119:16:221
21028991715,1cyclictest313-21systemd-journal19:35:013
21023991717,0cyclictest0-21swapper/219:56:222
21021991717,0cyclictest0-21swapper/120:21:221
21017991717,0cyclictest23754-21apt-get19:16:220
21017991717,0cyclictest0-21swapper/020:41:210
21017991717,0cyclictest0-21swapper/019:51:220
21017991716,1cyclictest5791-21perf19:45:000
21028991613,2cyclictest2005-21taskset20:42:143
21023991615,1cyclictest21356-21apt-get19:11:212
2102399160,15cyclictest0-21swapper/219:46:212
2102399160,0cyclictest0-21swapper/219:36:212
2102899154,5cyclictest0-21swapper/320:06:213
21028991515,0cyclictest0-21swapper/319:46:213
21017991515,0cyclictest0-21swapper/020:46:210
21017991515,0cyclictest0-21swapper/020:16:210
21017991515,0cyclictest0-21swapper/019:46:220
2101799150,2cyclictest0-21swapper/019:21:220
21028991412,1cyclictest28211-21apt-get19:25:023
2102899140,0cyclictest0-21swapper/320:15:513
2102399140,14cyclictest0-21swapper/221:09:092
2102399140,0cyclictest0-21swapper/219:44:442
2102199140,0cyclictest0-21swapper/120:40:131
2101799140,14cyclictest0-21swapper/019:10:290
2101799140,0cyclictest0-21swapper/020:51:000
2101799140,0cyclictest0-21swapper/020:28:460
2101799140,0cyclictest0-21swapper/019:31:470
21028991313,0cyclictest0-21swapper/320:25:353
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional