You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-05 - 12:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Fri Jun 05, 2026 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1495399280,23cyclictest24381-21ssh23:26:002
14953992721,1cyclictest15588-21ssh21:17:152
14953992720,1cyclictest9002-21munin-plugin-st20:05:002
1495499260,25cyclictest0-21swapper/323:51:153
14953992621,0cyclictest21649-21apt-get21:53:552
1495399260,22cyclictest6336-21kworker/u8:321:20:192
1495199262,0cyclictest62550irq/127-eno123:50:410
14954992523,2cyclictest0-21swapper/321:32:463
14954992523,1cyclictest8617-21diskmemload22:49:413
14954992520,4cyclictest0-21swapper/323:18:593
1495499250,24cyclictest0-21swapper/323:57:343
14953992520,1cyclictest3036-21ssh00:06:452
1495399250,21cyclictest5098-21ssh22:38:442
1495399250,21cyclictest18770-21ssh23:20:292
14952992523,1cyclictest26586-21entropy00:28:541
1495299250,24cyclictest0-21swapper/123:33:541
1495199250,0cyclictest8617-21diskmemload21:59:050
14954992423,1cyclictest0-21swapper/322:34:593
14954992422,1cyclictest2287-21apt-get19:53:533
14954992420,4cyclictest8617-21diskmemload23:43:373
14954992420,4cyclictest0-21swapper/322:57:153
14954992420,4cyclictest0-21swapper/321:25:093
14954992420,4cyclictest0-21swapper/321:03:543
14954992419,4cyclictest29571-21latency_hist22:00:013
14954992418,5cyclictest18800-21munin-run21:50:003
1495499240,24cyclictest0-21swapper/300:13:063
1495499240,23cyclictest0-21swapper/321:43:363
1495499240,23cyclictest0-21swapper/321:14:103
1495499240,20cyclictest0-21swapper/321:15:593
1495499240,20cyclictest0-21swapper/300:15:453
1495499240,1cyclictest0-21swapper/322:03:553
1495499240,1cyclictest0-21swapper/300:39:463
14953992419,1cyclictest30848-21ssh22:31:402
1495399240,21cyclictest0-21swapper/222:18:442
14952992424,0cyclictest0-21swapper/122:57:451
14952992422,1cyclictest30207-21ssh00:32:041
14952992422,1cyclictest0-21swapper/123:25:001
14952992421,2cyclictest1-21systemd23:40:001
1495299241,22cyclictest1757-21sh22:04:071
1495299240,23cyclictest8617-21diskmemload23:27:011
1495199240,23cyclictest29836-21cron21:30:010
1495199240,23cyclictest24724-21sh22:25:370
1495199240,23cyclictest0-21swapper/022:17:500
1495199240,0cyclictest0-21swapper/023:19:340
1495199240,0cyclictest0-21swapper/021:34:530
14954992323,0cyclictest0-21swapper/323:26:423
14954992323,0cyclictest0-21swapper/322:11:383
14954992323,0cyclictest0-21swapper/300:00:463
14954992322,0cyclictest8617-21diskmemload22:37:133
14954992320,3cyclictest15492-21apt-get19:13:523
14954992317,5cyclictest0-21swapper/320:13:523
1495499230,23cyclictest8617-21diskmemload23:30:013
1495499230,23cyclictest34-21ksoftirqd/323:06:263
1495499230,23cyclictest0-21swapper/323:01:533
1495499230,23cyclictest0-21swapper/322:17:073
1495499230,22cyclictest8070-21sh23:10:213
1495499230,22cyclictest0-21swapper/323:38:423
1495499230,22cyclictest0-21swapper/321:50:423
1495499230,22cyclictest0-21swapper/300:24:463
1495499230,1cyclictest18675-21ssh23:20:123
1495499230,0cyclictest8617-21diskmemload22:40:143
1495499230,0cyclictest0-21swapper/322:29:373
1495499230,0cyclictest0-21swapper/322:08:373
1495499230,0cyclictest0-21swapper/300:30:283
14953992322,1cyclictest8617-21diskmemload23:32:092
14953992321,1cyclictest18220-21apt-get00:20:022
14953992321,1cyclictest0-21swapper/222:43:172
1495399230,2cyclictest9840-21ssh21:11:322
1495399230,23cyclictest0-21swapper/222:23:022
1495399230,22cyclictest8709-21sh22:10:282
1495399230,22cyclictest8617-21diskmemload23:55:192
1495399230,22cyclictest8617-21diskmemload22:26:382
1495399230,22cyclictest8617-21diskmemload21:55:252
1495399230,22cyclictest5248-21ssh21:38:192
1495399230,22cyclictest4389-21sh23:07:482
1495399230,22cyclictest29856-21latency_hist21:30:012
1495399230,22cyclictest28264-21ssh22:59:032
1495399230,22cyclictest14339-21ssh00:17:552
1495399230,22cyclictest13925-21sh23:16:072
1495399230,22cyclictest11885-21ssh00:14:312
1495399230,22cyclictest0-21swapper/223:44:112
1495399230,0cyclictest0-21swapper/222:45:442
1495399230,0cyclictest0-21swapper/200:33:042
1495399230,0cyclictest0-21swapper/200:28:082
14952992323,0cyclictest0-21swapper/122:51:241
14952992323,0cyclictest0-21swapper/122:18:461
14952992323,0cyclictest0-21swapper/100:35:241
14952992321,1cyclictest17570-21apt-get00:20:011
14952992321,1cyclictest0-21swapper/122:15:011
14952992321,1cyclictest0-21swapper/121:15:251
1495299230,2cyclictest21582-21ssh21:23:151
1495299230,2cyclictest13669-21ssh22:45:021
1495299230,22cyclictest7249-21sh00:10:051
1495299230,22cyclictest31179-21ssh22:32:181
1495299230,22cyclictest3022-21ssh22:35:391
1495299230,22cyclictest20124-21ssh22:21:331
1495299230,22cyclictest0-21swapper/123:17:161
1495299230,0cyclictest8617-21diskmemload00:07:191
1495299230,0cyclictest0-21swapper/123:55:421
1495299230,0cyclictest0-21swapper/123:50:431
1495299230,0cyclictest0-21swapper/123:11:211
1495299230,0cyclictest0-21swapper/123:02:431
1495299230,0cyclictest0-21swapper/122:05:471
14951992323,0cyclictest0-21swapper/021:21:260
14951992323,0cyclictest0-21swapper/000:12:260
14951992322,1cyclictest31446-21chrt23:33:310
14951992322,1cyclictest0-21swapper/000:38:480
14951992321,1cyclictest7105-21sendmail-msp23:40:000
14951992321,1cyclictest30777-21ssh00:02:410
14951992321,1cyclictest11398-21perf20:10:000
14951992321,1cyclictest0-21swapper/023:42:400
14951992321,1cyclictest0-21swapper/021:15:340
14951992321,1cyclictest0-21swapper/000:15:070
14951992321,1cyclictest0-21swapper/000:07:170
14951992320,2cyclictest21388-21ls20:30:010
14951992320,2cyclictest21388-21ls20:30:010
1495199230,2cyclictest19591-21sh00:22:060
1495199230,23cyclictest0-21swapper/022:54:550
1495199230,22cyclictest8617-21diskmemload23:22:290
1495199230,22cyclictest7538-21sh23:09:460
1495199230,22cyclictest30228-21ssh23:00:550
1495199230,22cyclictest0-21swapper/022:36:090
1495199230,22cyclictest0-21swapper/022:01:450
1495199230,22cyclictest0-21swapper/000:30:480
1495199230,1cyclictest8617-21diskmemload21:36:070
1495199230,1cyclictest27791-21ssh22:58:590
1495199230,1cyclictest27184-21ssh23:28:580
1495199230,0cyclictest8617-21diskmemload21:40:060
1495199230,0cyclictest0-21swapper/023:10:120
1495199230,0cyclictest0-21swapper/021:48:140
1495199230,0cyclictest0-21swapper/021:10:090
14954992222,0cyclictest0-21swapper/321:37:053
14954992222,0cyclictest0-21swapper/300:05:493
14954992218,3cyclictest0-21swapper/300:25:083
1495499220,22cyclictest21525-21sh21:23:103
1495499220,21cyclictest0-21swapper/319:23:533
1495499220,1cyclictest8617-21diskmemload23:45:573
1495499220,1cyclictest18997-21ssh22:50:033
14953992222,0cyclictest0-21swapper/222:01:392
14953992222,0cyclictest0-21swapper/221:34:072
14953992221,1cyclictest783-21snmpd22:54:322
14953992221,1cyclictest2432-21apt-get22:05:012
1495399220,21cyclictest3980-21ssh00:38:262
1495399220,21cyclictest30392-21ssh23:01:082
1495399220,21cyclictest18556-21ssh23:50:292
1495399220,21cyclictest14450-21ssh21:46:122
1495399220,21cyclictest0-21swapper/223:35:282
1495399220,21cyclictest0-21swapper/220:53:522
1495399220,21cyclictest0-21swapper/200:00:172
1495399220,1cyclictest9428-21ssh23:12:232
1495399220,1cyclictest21410-21idleruntime-cro20:30:012
1495399220,1cyclictest21410-21idleruntime-cro20:30:012
1495399220,1cyclictest14607-21sh23:47:282
14952992222,0cyclictest8617-21diskmemload23:46:071
14952992221,1cyclictest31192-21ssh00:03:231
14952992221,1cyclictest13008-21sh00:15:431
14952992221,1cyclictest0-21swapper/123:44:381
14952992220,1cyclictest0-21swapper/122:25:261
1495299220,22cyclictest0-21swapper/121:44:281
1495299220,21cyclictest0-21swapper/119:33:531
1495299220,1cyclictest31037-21sh21:31:271
1495299220,1cyclictest19646-21ssh21:51:011
1495299220,1cyclictest14339-21apt-get20:18:531
1495299220,1cyclictest0-21swapper/121:11:421
1495299220,0cyclictest0-21swapper/121:36:151
1495299220,0cyclictest0-21swapper/120:43:531
14951992222,0cyclictest8617-21diskmemload23:56:130
14951992222,0cyclictest25051-21kworker/u8:122:31:370
14951992222,0cyclictest0-21swapper/023:46:020
14951992220,1cyclictest29552-21apt-get20:48:530
1495199220,22cyclictest0-21swapper/022:44:280
1495199220,21cyclictest6800-21apt-get21:08:540
1495199220,21cyclictest0-21swapper/019:48:530
1495199220,21cyclictest0-21swapper/000:25:480
1495199220,1cyclictest22160-21perf19:25:000
1495199220,1cyclictest0-21swapper/022:24:450
1495199220,0cyclictest0-21swapper/021:51:500
14954992120,0cyclictest0-21swapper/319:48:533
1495499210,20cyclictest0-21swapper/319:58:533
1495499210,0cyclictest25096-21apt-get19:33:533
14953992119,1cyclictest622-21gdbus19:45:012
14953992119,1cyclictest16198-21apt-get20:20:002
14953992119,1cyclictest0-21swapper/219:35:002
1495399210,21cyclictest0-21swapper/221:40:272
1495399210,0cyclictest11941-21apt-get20:13:522
14952992121,0cyclictest0-21swapper/119:28:521
14952992120,1cyclictest29909-21apt-get19:43:531
14952992120,1cyclictest25322-21ssh21:56:301
14952992119,1cyclictest21402-21munin-run20:30:011
14952992119,1cyclictest21402-21munin-run20:30:011
1495299210,21cyclictest8617-21diskmemload21:45:391
1495299210,21cyclictest0-21swapper/122:40:051
1495299210,20cyclictest0-21swapper/119:13:521
1495299210,0cyclictest9547-21apt-get20:08:521
1495299210,0cyclictest0-21swapper/120:48:531
14951992121,0cyclictest0-21swapper/022:05:110
14951992121,0cyclictest0-21swapper/020:23:530
1495199210,21cyclictest0-21swapper/022:45:280
1495199210,0cyclictest4682-21apt-get19:58:530
1495199210,0cyclictest0-21swapper/019:53:530
14954992020,0cyclictest0-21swapper/319:43:533
14954992018,1cyclictest26762-21apt-get20:43:533
1495499200,19cyclictest0-21swapper/320:53:523
14953992020,0cyclictest0-21swapper/220:48:532
14953992020,0cyclictest0-21swapper/220:08:522
1495399200,0cyclictest0-21swapper/219:23:522
14952992020,0cyclictest0-21swapper/119:58:531
14952992019,0cyclictest31947-21apt-get20:53:521
1495299200,0cyclictest21950-21apt-get20:33:541
1495299200,0cyclictest0-21swapper/119:23:531
14951992020,0cyclictest0-21swapper/020:43:530
14951992020,0cyclictest0-21swapper/020:03:530
14951992018,1cyclictest1376-21munin-run20:55:000
1495199200,19cyclictest26933-21apt19:35:000
14954991919,0cyclictest0-21swapper/320:45:023
14953991919,0cyclictest0-21swapper/221:08:542
14953991917,1cyclictest17890-21apt-get19:18:542
14952991919,0cyclictest0-21swapper/121:08:541
14952991919,0cyclictest0-21swapper/119:38:531
1495299190,1cyclictest0-21swapper/120:58:531
14951991919,0cyclictest0-21swapper/021:03:540
14951991919,0cyclictest0-21swapper/019:38:530
14954991818,0cyclictest0-21swapper/320:38:533
14954991818,0cyclictest0-21swapper/320:28:533
14954991818,0cyclictest0-21swapper/320:28:533
14953991818,0cyclictest0-21swapper/220:58:532
14953991818,0cyclictest0-21swapper/220:43:532
14953991818,0cyclictest0-21swapper/220:33:542
14952991818,0cyclictest2287-21apt-get19:53:531
14952991818,0cyclictest19009-21perf20:25:011
14951991818,0cyclictest0-21swapper/020:58:530
14951991818,0cyclictest0-21swapper/020:13:520
14951991818,0cyclictest0-21swapper/019:28:530
14951991818,0cyclictest0-21swapper/019:13:520
14953991717,0cyclictest0-21swapper/219:30:002
1495399170,17cyclictest0-21swapper/220:38:532
14951991715,1cyclictest16198-21apt-get20:20:000
1495199170,16cyclictest0-21swapper/020:38:530
14954991616,0cyclictest1931-21apt-get20:58:533
14954991613,2cyclictest0-21swapper/321:07:323
1495499160,14cyclictest0-21swapper/320:16:383
1495499160,14cyclictest0-21swapper/319:16:333
14953991615,1cyclictest27492-21apt-get19:38:532
14952991614,1cyclictest24989-21hddtemp_smartct20:38:551
14951991615,1cyclictest17890-21apt-get19:18:540
1495199160,15cyclictest31735-21sh19:45:010
1495499150,5cyclictest0-21swapper/319:38:543
1495499150,15cyclictest0-21swapper/320:32:073
1495499150,15cyclictest0-21swapper/320:02:493
1495499150,0cyclictest0-21swapper/320:24:263
14953991515,0cyclictest32302-21apt-get19:48:532
14953991515,0cyclictest0-21swapper/221:03:532
14952991515,0cyclictest0-21swapper/119:48:531
1495499140,14cyclictest0-21swapper/320:05:123
1495499140,0cyclictest0-21swapper/319:25:263
14953991414,0cyclictest0-21swapper/220:20:062
14953991414,0cyclictest0-21swapper/219:55:592
1495399140,14cyclictest0-21swapper/219:50:102
1495399140,14cyclictest0-21swapper/219:11:222
14952991414,0cyclictest0-21swapper/121:00:081
1495299140,0cyclictest0-21swapper/120:00:051
1495299140,0cyclictest0-21swapper/119:15:361
1495199140,14cyclictest0-21swapper/020:30:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional