offset background color outside border with css?

Solution:

You could replace border with outline, and use a negative outline-offset value.

*Note that this is not supported by Internet Explorer

 

div {
  background: black;
  outline: 5px solid yellow;
  outline-offset: -10px;
  width: 300px;
  height: 300px;
}
<div></div>