You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-01 - 12:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Wed Jul 01, 2026 00:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1565899284,23cyclictest754-21sh19:45:002
1565899272,24cyclictest9624-21diskmemload22:58:562
1565899271,25cyclictest0-21swapper/223:18:502
15647992721,5cyclictest0-21swapper/000:11:070
1565899262,24cyclictest9624-21diskmemload21:34:102
1565899261,24cyclictest0-21swapper/221:20:212
15647992623,3cyclictest0-21swapper/022:23:340
15647992623,3cyclictest0-21swapper/000:20:350
15647992621,4cyclictest0-21swapper/022:53:010
15647992620,1cyclictest0-21swapper/022:11:260
1564799260,25cyclictest0-21swapper/023:38:060
1564799260,20cyclictest12423-21tail23:06:050
1564799260,0cyclictest0-21swapper/023:40:470
15658992524,0cyclictest14325-21apt-get00:36:052
15658992520,1cyclictest19838-21df22:16:022
1565899251,24cyclictest0-21swapper/223:05:062
1565899250,1cyclictest18166-21ssh00:10:302
1565399250,24cyclictest9624-21diskmemload22:16:431
1565399250,1cyclictest23540-21apt-get19:26:011
15647992522,3cyclictest0-21swapper/023:03:310
15647992521,0cyclictest0-21swapper/023:51:280
15647992520,1cyclictest0-21swapper/022:08:200
15647992520,0cyclictest9624-21diskmemload21:42:100
15647992520,0cyclictest0-21swapper/023:31:180
15647992519,1cyclictest6270-21ssh22:31:540
15647992519,1cyclictest0-21swapper/023:22:270
15647992519,1cyclictest0-21swapper/021:49:520
15647992518,1cyclictest32425-21acpi22:56:020
1564799250,21cyclictest0-21swapper/023:59:140
1564799250,20cyclictest0-21swapper/021:30:070
1564799250,1cyclictest12942-21diskmemload00:34:320
1564799250,0cyclictest0-21swapper/023:19:000
1564799250,0cyclictest0-21swapper/000:03:480
15663992422,1cyclictest29994-21apt-get20:46:033
1566399240,2cyclictest20406-21turbostat19:20:013
1566399240,24cyclictest0-21swapper/323:45:133
1566399240,23cyclictest9624-21diskmemload00:03:213
1566399240,23cyclictest7990-21sh22:05:523
1566399240,23cyclictest5517-21ssh00:27:053
1566399240,23cyclictest0-21swapper/323:28:173
1566399240,21cyclictest9624-21diskmemload21:51:393
1566399240,1cyclictest13682-21ssh23:06:133
15658992423,0cyclictest0-21swapper/222:22:222
1565899242,22cyclictest21094-21ssh23:41:352
15658992422,1cyclictest29483-21sh00:20:402
1565899242,21cyclictest20081-21sh21:46:322
15658992422,1cyclictest12589-21sh22:37:462
15658992422,1cyclictest0-21swapper/222:51:462
15658992421,2cyclictest4851-21dump-pmu-power21:00:012
1565899241,22cyclictest6478-21ssh00:28:262
1565899240,24cyclictest9624-21diskmemload22:01:392
1565899240,23cyclictest13632-21ssh21:12:362
1565899240,23cyclictest0-21swapper/221:44:042
1565899240,1cyclictest18975-21ssh21:17:132
1565399240,23cyclictest9624-21diskmemload23:25:521
1565399240,23cyclictest9624-21diskmemload21:37:511
1565399240,23cyclictest27141-21hddtemp_smartct22:51:071
1565399240,23cyclictest19133-21rm21:17:251
1565399240,23cyclictest0-21swapper/123:59:141
1565399240,23cyclictest0-21swapper/121:10:501
1565399240,23cyclictest0-21swapper/120:31:021
1565399240,23cyclictest0-21swapper/119:31:021
1565399240,0cyclictest9624-21diskmemload23:07:451
15647992423,1cyclictest0-21swapper/000:18:380
15647992421,3cyclictest0-21swapper/021:10:450
15647992420,0cyclictest9624-21diskmemload22:03:370
1564799240,24cyclictest0-21swapper/022:17:340
1564799240,23cyclictest785-21munin-run19:45:000
1564799240,23cyclictest21636-21sh21:20:270
1564799240,23cyclictest0-21swapper/023:10:390
1564799240,20cyclictest9624-21diskmemload00:25:230
1564799240,20cyclictest0-21swapper/022:36:330
1564799240,20cyclictest0-21swapper/021:57:410
1564799240,0cyclictest9624-21diskmemload21:15:440
1564799240,0cyclictest0-21swapper/023:27:110
1564799240,0cyclictest0-21swapper/021:52:460
1564799240,0cyclictest0-21swapper/021:37:340
1564799240,0cyclictest0-21swapper/021:26:440
15663992323,0cyclictest0-21swapper/323:53:413
15663992323,0cyclictest0-21swapper/323:02:113
15663992323,0cyclictest0-21swapper/322:57:523
15663992323,0cyclictest0-21swapper/322:35:203
15663992323,0cyclictest0-21swapper/322:31:173
15663992321,1cyclictest9624-21diskmemload22:14:233
15663992321,1cyclictest19373-21ssh23:11:173
15663992320,2cyclictest30380-21ssh22:25:393
15663992320,2cyclictest16982-21ssh22:41:123
1566399230,2cyclictest25736-21sh21:23:403
1566399230,2cyclictest15812-21ssh23:37:163
1566399230,23cyclictest0-21swapper/323:30:313
1566399230,23cyclictest0-21swapper/321:58:213
1566399230,22cyclictest5509-21sh21:34:453
1566399230,22cyclictest14951-21sh21:42:123
1566399230,22cyclictest14669-21sh00:06:043
1566399230,22cyclictest0-21swapper/323:21:033
1566399230,22cyclictest0-21swapper/322:25:013
1566399230,22cyclictest0-21swapper/321:10:573
1566399230,0cyclictest0-21swapper/323:58:003
1566399230,0cyclictest0-21swapper/322:04:313
1566399230,0cyclictest0-21swapper/321:26:333
1566399230,0cyclictest0-21swapper/300:33:043
15658992323,0cyclictest0-21swapper/223:31:472
15658992322,1cyclictest13076-21ssh22:10:012
15658992322,1cyclictest0-21swapper/200:06:492
15658992321,1cyclictest0-21swapper/223:51:282
15658992321,1cyclictest0-21swapper/222:25:212
1565899231,22cyclictest0-21swapper/221:25:302
1565899231,21cyclictest6395-21sh21:35:392
1565899231,21cyclictest528-21rm21:58:382
1565899231,21cyclictest0-21swapper/223:47:022
1565899230,23cyclictest0-21swapper/223:55:522
1565899230,23cyclictest0-21swapper/223:25:002
1565899230,23cyclictest0-21swapper/200:00:062
1565899230,22cyclictest7932-21ssh00:30:032
1565899230,22cyclictest26161-21rm00:16:242
1565899230,22cyclictest0-21swapper/223:00:522
1565899230,0cyclictest0-21swapper/223:14:572
1565899230,0cyclictest0-21swapper/222:45:122
15653992323,0cyclictest0-21swapper/121:42:161
15653992323,0cyclictest0-21swapper/121:21:171
15653992323,0cyclictest0-21swapper/100:08:571
15653992321,1cyclictest15223-21sh20:15:011
15653992321,1cyclictest0-21swapper/122:57:201
15653992321,1cyclictest0-21swapper/122:10:051
15653992321,1cyclictest0-21swapper/120:46:031
15653992320,2cyclictest21857-21ssh21:48:521
1565399230,23cyclictest0-21swapper/121:31:051
1565399230,23cyclictest0-21swapper/100:12:591
1565399230,22cyclictest9624-21diskmemload22:25:351
1565399230,22cyclictest9052-21ssh22:35:191
1565399230,22cyclictest5937-21ssh22:31:291
1565399230,22cyclictest3519-21apt-get19:51:031
1565399230,22cyclictest29619-21sh23:50:211
1565399230,22cyclictest28397-21ssh23:20:371
1565399230,22cyclictest27219-21cron20:40:001
1565399230,22cyclictest1994-21sh22:00:121
1565399230,22cyclictest18929-21apt-get23:41:021
1565399230,22cyclictest17675-21basename20:20:011
1565399230,22cyclictest0-21swapper/121:52:451
1565399230,1cyclictest29364-21apt-get21:56:041
1565399230,0cyclictest0-21swapper/123:47:311
1565399230,0cyclictest0-21swapper/123:37:111
1565399230,0cyclictest0-21swapper/100:15:431
15647992321,1cyclictest30742-21ssh22:26:040
15647992321,1cyclictest0-21swapper/022:43:420
15647992320,0cyclictest9624-21diskmemload00:09:560
1564799230,22cyclictest0-21swapper/023:45:250
1564799230,22cyclictest0-21swapper/022:46:580
1564799230,0cyclictest0-21swapper/000:36:130
15663992222,0cyclictest0-21swapper/323:40:023
15663992222,0cyclictest0-21swapper/322:50:373
15663992220,1cyclictest22465-21sh23:15:203
15663992220,1cyclictest0-21swapper/321:35:033
15663992220,1cyclictest0-21swapper/321:15:403
15663992220,1cyclictest0-21swapper/321:00:013
1566399220,22cyclictest9624-21diskmemload21:45:443
1566399220,21cyclictest18576-21apt-get00:10:593
1566399220,21cyclictest17997-21apt-get20:21:033
1566399220,21cyclictest0-21swapper/322:48:213
1566399220,1cyclictest29444-21ssh00:20:363
1566399220,1cyclictest27270-21munin-run20:40:003
1566399220,1cyclictest0-21swapper/300:37:303
15658992222,0cyclictest0-21swapper/221:51:472
15658992220,1cyclictest25594-21apt19:30:012
15658992220,1cyclictest0-21swapper/219:50:002
1565899220,22cyclictest0-21swapper/223:35:152
1565899220,21cyclictest6882-21ssh22:32:482
1565899220,21cyclictest0-21swapper/222:40:272
1565899220,0cyclictest0-21swapper/223:20:302
15653992222,0cyclictest0-21swapper/123:10:431
15653992221,1cyclictest9624-21diskmemload00:28:241
1565399220,22cyclictest0-21swapper/122:40:281
1565399220,22cyclictest0-21swapper/100:35:481
1565399220,22cyclictest0-21swapper/100:30:151
1565399220,21cyclictest5446-21ssh23:00:061
1565399220,21cyclictest10728-21apt-get20:06:021
1565399220,21cyclictest0-21swapper/121:25:321
1565399220,1cyclictest8030-21ssh22:05:541
1565399220,1cyclictest20946-21apt-get22:46:031
1565399220,1cyclictest0-21swapper/122:20:321
15647992222,0cyclictest0-21swapper/020:01:020
15647992220,1cyclictest20417-21dump-pmu-power19:20:010
15647992220,1cyclictest15937-21apt-get19:11:030
15647992220,1cyclictest15937-21apt-get19:11:030
15647992220,1cyclictest0-21swapper/020:30:000
1564799220,21cyclictest7584-21apt-get21:06:040
1564799220,21cyclictest2771-21apt-get20:56:020
1564799220,21cyclictest22788-21apt-get20:31:020
1564799220,21cyclictest0-21swapper/020:46:030
1564799220,21cyclictest0-21swapper/019:26:010
15663992121,0cyclictest0-21swapper/322:15:033
15663992120,1cyclictest0-21swapper/319:56:033
1566399210,20cyclictest0-21swapper/320:11:033
15658992121,0cyclictest0-21swapper/220:16:012
15658992120,0cyclictest0-21swapper/220:41:042
1565899210,21cyclictest0-21swapper/222:06:422
1565899210,20cyclictest0-21swapper/220:21:032
1565899210,1cyclictest15937-21apt-get19:11:032
1565899210,1cyclictest15937-21apt-get19:11:032
1565899210,0cyclictest0-21swapper/220:51:022
1565399210,0cyclictest0-21swapper/120:41:031
1565399210,0cyclictest0-21swapper/120:26:021
15647992119,1cyclictest30778-21idleruntime-cro19:40:000
15647992119,1cyclictest2431-21cat20:55:010
15663992019,1cyclictest0-21swapper/321:06:043
15663992016,3cyclictest7247-21perf21:05:013
15658992020,0cyclictest18330-21apt-get19:16:022
15658992020,0cyclictest0-21swapper/221:06:042
15658992020,0cyclictest0-21swapper/220:11:032
15658992020,0cyclictest0-21swapper/219:21:032
15658992018,1cyclictest7971-21cron20:00:012
1565899200,0cyclictest0-21swapper/220:36:032
15653992020,0cyclictest0-21swapper/121:06:041
15653992020,0cyclictest0-21swapper/120:01:021
15653992020,0cyclictest0-21swapper/119:16:021
15653992018,1cyclictest7955-21cron20:00:011
15653992018,1cyclictest1110-21apt-get19:46:021
15647992020,0cyclictest0-21swapper/019:56:020
15647992017,2cyclictest20061-21latency_hist20:25:000
1564799200,20cyclictest0-21swapper/019:51:030
15663991919,0cyclictest0-21swapper/320:01:023
15663991918,0cyclictest0-21swapper/319:51:033
1566399190,18cyclictest28374-21apt19:35:003
15658991919,0cyclictest8333-21apt-get20:01:022
15647991919,0cyclictest26328-21apt-get19:31:020
15647991919,0cyclictest0-21swapper/020:06:020
15663991817,1cyclictest0-21swapper/319:41:023
15663991815,2cyclictest25574-21cron19:30:013
15658991818,0cyclictest32041-21apt-get20:50:012
15658991818,0cyclictest0-21swapper/219:51:032
15658991817,1cyclictest0-21swapper/220:26:022
15658991816,1cyclictest0-21swapper/220:06:032
15653991818,0cyclictest0-21swapper/120:56:021
15653991817,1cyclictest0-21swapper/119:41:021
1565399180,17cyclictest20754-21apt-get19:21:031
15647991818,0cyclictest0-21swapper/020:41:030
15663991717,0cyclictest0-21swapper/319:21:033
15663991714,2cyclictest32041-21apt-get20:50:033
15653991717,0cyclictest0-21swapper/119:36:021
15653991715,1cyclictest7219-21cron21:05:011
15647991717,0cyclictest0-21swapper/020:11:030
15647991714,2cyclictest17719-21munin-run20:20:010
15663991614,1cyclictest20391-21apt-get20:26:023
15663991614,1cyclictest18002-21turbostat19:15:013
15663991614,1cyclictest18002-21turbostat19:15:013
15663991613,1cyclictest0-21swapper/320:41:093
1565899160,1cyclictest24847-21latency_hist20:35:002
1565899160,15cyclictest26566-21cstates19:31:032
15653991616,0cyclictest0-21swapper/120:21:031
1564799160,1cyclictest27228-21sh20:40:000
15663991515,0cyclictest0-21swapper/319:46:023
1565899152,12cyclictest5186-21apt-get21:01:012
15647991514,0cyclictest0-21swapper/021:01:020
1566399144,9cyclictest10784-21sort20:06:033
15663991414,0cyclictest0-21swapper/320:31:353
15663991414,0cyclictest0-21swapper/320:16:013
1566399140,14cyclictest0-21swapper/319:35:563
1565899140,14cyclictest0-21swapper/219:35:072
1565399140,14cyclictest0-21swapper/120:50:451
1565399140,0cyclictest0-21swapper/119:10:091
1565399140,0cyclictest0-21swapper/119:10:091
1564799140,0cyclictest0-21swapper/019:45:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional